The Teller of secrets only restocks attribute books not ability books. In my case it seems to restock a couple of times during a level but I only got the ability increase books once. As I understand it they are both supposed to restock.