I am very fine with 4, Pathfinder games have 6 and it is sometimes a chore to go through so many turns. The worst part has to be the buffing ritual you have to do at the start of each fights.
It would be a bit awkward for multiplayer as well, I feel like 4 players max is the optimal number for an all-players party.