Same thing happened for me. I ended up abandoning the quest line till my next playthrough.
Mizora is stuck repeating the same line about going upstairs.
I moved on, eventually killed Ansur and the quest log wants me to talk to the Duke a my camp, but of course he is not there so...
