The button is quite hard to find. It is on the wall to the left of the barrier. The wall between the hidden library and the normal tower, but on the side of the barrier.
The lever in the library stops the fire, that's right. But I mean the lever at the gate across the barrier.
Google don't gave me answers so far. I found only people who also puzzled over both things.
