Did you mindread the mute goblin, and then read the book he was thinking of in the bookcase on the opposite side of the room (at the far back, on the right as you enter the room)? You may need to scroll down the list of books.
On the floor above, where you need to go for a key, there is a hidden room, opened by lighting the two candles on either side at the back.
I don't recall a locked door on the third floor, but you may need to open the secret room to get access. The door on the fourth floor will be opened by Sassan, once you have the name of the demon, locked away in the secret room (after entering the summoning chamber, you will loose access to many of the areas and NPCs in Broken Valley and Sentinel Island).