Only door?
At the Tollhouse, I had the mage-trader on the roof of the building hitting my party all inside on the first floor.. Not sure how she did it, she shouldn't even be able to target anyone from where she was.
Not just there ...
Many NPCs seem to ignore walls, and roofs ...
I had this problem even with Goblins, and Ogres in Blighted Villiage.