I have the key for the armoury but where is the entrance?

I can see the room when im downstairs in the tavern but there doesnt seem to be an entrance. I cant find any stairs down in any of the builds frown