I actually did not yet see any real argument why a party of 6 would be more fun.
The only reason I can imagine is that then you can have 1 of everything in the party. But that for me personally would ruin the fun of having to choose whom I bring with myself onto a quest, and also lower the replay value of the game.