I'd be happy if they just added one more for a 5 player party.
Main reason being it opens up for a lot more combo's of classes.

I'm definitely positive to a 6 party as well, but 4 just locks you too hard to the archetypes of classes you have to bring.