The creator of the room is the owner of the Replay. Only the owner of the Replay can delete a Replay entirely or download the full audio.
You will not be able to delete a Replay if you were a Moderator, Speaker on stage, or Audience member, as you're not the owner of the content, but you can always remove a Replay from your own personal profile — learn more here.