Right. Combat will probably be over quicker. But I just don't buy the long combat = bad combat. If we were to consistently apply the "more = longer = worse" we should eliminate summons, familiars, undead, etc. because those are drags on combat completion.
Said it before and I'll say it again -- you use different, more diverse and more interesting strategies with larger parties. More party members = more fun.