Personally the issue is how playable the game is with different character combinations if you get bottlenecked down to a small party that won't change, particularly if your "main" isn't one of the core roles.
What are these core roles in dnd 5e that you can't fill in with wide variety of classes?