Swen mentioned Multiplayer and the reasoning for 4 man party in the Dropped frames interview, if you are curious.
In short, it's for stability and balancing purposes. If you want more party members, you will have mods.
I hate large battles at the moment, I can't even imagine I'd be running around with a party of 6 right now.
