My XP:
If you have axe and letter at the same time, the guards let you keep it.
if you go in and one of it is missing, you have to throw.

Kiya