We have 2 PS5s in our house and this has been our experience on both. Constant crashes, bugged out conversations, unresponsive UI and controls, inability to switch party members, companions refusing to follow, cutscenes skipping out, no audio, buildings and areas not loading and my favorite, rubber-banding like crazy when walking through the lower city.
Rivington wasn't too bad, but once I hit the first Wrym's Rock bridge, good god. It took multiple crashes, reloads and the better part of an hour to even get into the audience chamber. Sadly, this is now typical. You can easily spend more time trying to coax the game to work then actually playing it. The lack of real acknowledgment from Larian makes the issues that much more vexing.