I’ve never seen this issue in my own playthrough. If you haven’t already, it might be worth reporting to Larian. The Report a Bug link along the top of the launcher will take you to the right place on their support site.

"You may call it 'nonsense' if you like, but I've heard nonsense, compared with which that would be as sensible as a dictionary!"