I had the same problem with the necromancy of thay, I have the dialogue option telling him I have something for him to consume, but when I pick it my only option is to say I don't actually want him to have it.
I also had the opposite problem on a different playthrough that I could feed him the book but it wasn't removed from my inventory, so I never needed to feed him anything else.