Not only does four limit party composition on party roles, but it also keep you from taking along that oddball/eccentric/quirky companion who doesn't bring much to combat but is a great companion for roleplaying and party interractions. With only four party slots I could never justify taking along that companion, which would be a huge shame.