It's just happening with the main house exit, not the hidden one. I think there are some NPCs I missed chatting with, but I'd rather not go through the fight at the gate to get back to them, which is my main problem. Have not tried a waypoint yet though, to be honest I use them so rarely I'd forgotten about them! That's definitely an experiment to try when next I load up the game :O
