Pindakaas, this "guard-theft" only takes place if you don't have both items at the same time (this was my XP) but deliver them one by one. As 1.0034 only requires the letter and not the axe anymore, I'm not sure, if the letter is taken then.