Speak with the prisoner, or find the secret room in one of the empty prison cells yourself.
Use what you find there to continue the way to your tower wink