Toss the letter into the room and pick it up again after you enter, or toss a teleporter stone in to bypass the guards altogether. If you had the letter when you first entered, if would have stayed in your inventory with the axe.