There's a number of items that he can devour - book, necklace, and a rather weird and useless weapon from the kua-toa.

So you generally don't need to resort to destroying really useful stuff - yet anyway, his appetite might worse in the next act.