I'd be cool with a party of 6. I think it would make for some really awesome additional fun in adventuring. But! There's got to be way more companions, and way more companion on companion interactions.
I believe the game is most likely just gonna stay a 4 member group game tho. Its a staple and works well enough.