It depends on the total length of the narrative. We've met these 5 companions in Act 1. If it's a 3 act narrative arc, then the ones you meet in Act 2 might hit differently. It could be a good thing or a bad thing. Maybe you're just so ingrained to your initial party that you don't want to change up to include a new companion, so they stay in camp. Alternatively, they could be really compelling and a breath of fresh air that helps push you through to the end.
But 3rd Act companions will just suck. You only met them and then the game is over. Their personal quest arcs would be too short too. What's even the point of getting to know them unless they have significant main plot relevance.