your max party size is actually 9 because you can have 4 pets and one special case which is sort of a pet 'of a pet
it was going to be like Dos2 but people called them out and Larian moved to a more 2+2 senario, for example Shadowheart and gith girl don't get on and word is Wyll will take issue with your new demonhearted GF but according to untested rumor you can still keep them both happy if you play your cards just right
or of course just kill / sell them as slaves or even walk past leaving them to their fates