This is actually a good point, reading should not be considered a criminal offense. Even if you did it irl it would just be considered rude at most, nothing that anyone's going to start a fight over.
I also like the idea of having some books give (temporary or permanent) bonuses. They should definitely include rare, difficult-to-get books that boost an ability point, like in the first Baldur's Gate.
