After the meeting with Talana and then talking to Zandalor, I started wandering around exploring again. But every once in a while a message comes across the screen and a voice keeps pushing me towards Lovis Tower and one time when I entered the bandit camp, the voice seemed upset with me.
Should I have gone to Lovis Tower right after talking to Zandalor
