Personally, I'd prefer a party size of 5. Six is too big in my opinion, while four seems a tad too restrictive. But even if Larian insists on keeping the group size as it is, there will be mods to address it...