Most books and manuscripts are just for background information or for atmosphere. If an enemy drops a manuscript, someone gives you a book through a speech option or it seems quest related, then keep it, otherwise you do not need it. For example, there are a couple letters from one character to another mentioning criminal activities, which can be used to solve or advance certain quests.
