Personally I'd trust that if Larian want to make & balance the game around a 4 person group, then that is the optimal way to go. In fact I'd be concerned that if enough people keep clamouring for a 6 man group then they will end up using time & resources to cater to them, to the detriment of other aspects of the overall experience.