Bugs it was. I reloaded from the old save and when I got back up to the tower all was well again. The bandits attacked, I was able to talk to the prisoner, etc.

Thanks! I'm a dragon now, and it rocks.