I'd rather not have a larger party because combat takes long enough as it is. Fewer party members and fewer opponents means less time doing combat = more playthroughs = being able to bring along a different set of companions on the 2nd run rather than running with the same guys because I had room for everyone the first time.
