This is a computer game... not a table top one. An active party of four is plenty for a number of reasons
Well, you started making a right premise and used it to jump to the wrong conclusion. The fact that is a computer game and not a live tabletop session is precisely why it shines the most if you add a larger party and cast of characters compared to the latter.
Party control in Baldur's Gate 3 is a complete mess that begs to be addressed. SAY NO TO THE TOILET CHAIN