I feel the lore books are the first step in the right direction. But like others said I feel it can really be expanded upon.

I think a Compendium for all flora/fauna, geography, factions etc once you happen to run across the "lore" books. Better yet, have more unlocks of knowledge through RP options through dialogue to have an extra incentive Would be a much welcomed addition. Having a nice Map of the Sword Coast to get an extra visual I think could also add more to "where the heck am I" feeling.