Note that the loot in that chest is only ~ lvl 10, so if you wait till you have the key for it, the content will be relatively useless.
If you don't have enough Magic Unlock scrolls, just craft them: Magic Inkpot and Quill + Blank Witchcraft Scroll (Crafting 2)
