I feel like I'm fine with 4 because Larian's quality of life for many things making 6 just not fun to even imagine.

It's sad to say but many people asking for 6 aren't thinking about having to manage that in Larian's schema. It's just too cumbersome.

Maybe if you had 6 individual players.