Using a skill or stat book will remove it from your inventory. If you have books in your miscellaneous inventory section associated with quests, etc, for the most part they can be sold (for 3 gold), as can any randomly generated books (that can show up in different locations or as loot).
Welcome to the forum.
