6 is too many for a turn based game like this IMO. Some of the longer fights in act 1 already drag out a bit long and thats with 4 chars to control. I’d bet they play-tested 6 earlier in development and decided yeah this is too slow.
So don't use 6. There you go. I've solved your huge problem for you.