Well, welcome to the club.

We had dozens of multi-paged threads (currently merged in a Frankenstein-megathread in the appropriately named section) where many of us complained for months that this limitation to four character per party sucks in a CRPG of this kind.

Party control in Baldur's Gate 3 is a complete mess that begs to be addressed. SAY NO TO THE TOILET CHAIN