I imagine that Larian are not falling over themselves to stock random stuff at present, but perhaps the containers and bookshelves will be better stocked after EA.
Bookshelves can be good sources of in-jokes and general lore about the world, so it would be great to have this in BG3. Books that explain a little about the FR, books that give meta-knowledge useful when developing your character, and books that just have fun stuff. DA had a great series of love letters, for example, which could be found stuffed in odd corners around the gameworld.