This is a common viewpoint that I definitely agree with, even just one more at 5 would help a lot in making this game feel like a Baldur's Gate Title (though for me 6 is ideal). Hopefully with patch 4 they test implement this or respond to the feedback about party size.