Temporary fix is to swap characters and have them destroy the book. It will free the character in dialogue and still give you the rewards.