From the room with the poisoned imp, take the corridor east and then south, and you will come to the door/lever that you need (before getting to the library).