Another viewpoint into this is strengths and weaknesses of your party. If you have 6 members, you will have the right tool for everything in the game. However, if you have only 4 members, there might be some areas where you are lacking, you have weaknesses. This gives you an opportunity to be creative.

No healing? Well perhaps you need to stock lots of health potions, magical items or take another route and avoid taking any damage.

Nobody to search & disarm traps? Perhaps you need to make your tank capable of taking the hits then.

This means more replayability too, because if your first playthrough didn't have any arcane casters, perhaps quests and approaches you take are completely different than if you had one?