Bad news Guys, this has been the issue since launch on PC.
Zero acknowledgement from Larian.
Yes, this is kind of the reason I've given up hope on the ps5 version. They haven't been able to fix it on PC, it would seem the only way out is through brute force (huge CPU and GPU), for now. I believe they will place their bet on cross-play.