Clearly, a grand majority of people aren't having issues with this since the technical section of the forums aren't exactly flooded with complaints about problems with performance, so I'm either forced to assume that everyone has a monster PC, or that they just happen to be lucky to have a setup where it's not enough of an issue to matter.
Discussing with people on Twitch streams would lead you to a different conclusion.
I am in love with the graphics the game delivers but I also think many other games deliver rich(er) environments for lesser resources. EA is not an excuse for everything but in this case, it would make full sense for Larian to heavily monitor/log their engine behaviour thus degrading its performance while doing so.