I personally feel like 4 is the good enough for me. 5 - maybe, 6 - stretching it.

But that is mostly because I plan to play multiplayer once the game is out. 2-3 people I could find, but if I can find 4 then I'd rather play 5e...