Games will never be perfect no, but leaving when it clearly needs just a little more love to be close to as good as Act 1 in all the Acts are good reasons to be a bit disappointed. I can only speak for me, and for me Larian went from the company to watch for to a company to wait with buying their games.
Which is odd. Since this isn't new for Larian.
Divinity 2 also suffered from the exact same affliction. Act 1 is super polished and amazing (Thanks to extended development during Early Access). But then the later Acts are kind of rushed and unfinished, even with a "Definitive Edition" for extra work on the game the later acts pale in comparison to the polish and depth of Act 1.
It's simply a product of Larian's development process. Their nature of having Act 1 in Early Access and spending a majority of the game's development time on this act to address feedback from EA always ends up with the same result. Act 1 is polished and amazing. But they burn out after spending so much time tweaking this single Act thus later Acts don't get anywhere near enough attention to be complete, let alone comparable to Act 1.
I honestly believe that this method of using EA and additional development time is the primary reason for the faults in Larian titles. Too much time spent on Act 1 and not enough time on other Acts. Too much tweaking of Act 1 eating away at their passion for developing the game.