Well you're in for a treat. Because as it stands right now, according to the Early Access FAQ, there's a comment stating after Act 1 our party is locked with the people we have. Or something to that effect. They haven't clarified and it's causing its own stir, among the adding a 5th/6th slot for a party member. Personally I think it should be 5. 6 Might be a bit much to manage and create balance issues.
Was that actually confirmed for BG3 or is it rumored because that's how DOS2 was. Judging from the act 1 we have so far I find it hard to believe they'd cram another 2-3 companions in that area.
My guess that this is only for the Origin characters. So it either refers to people removed that you have not met on that map, as you likely can not return, or that for some reason certain NPCs will not be available any more due to story reasons or player choices. So let us say you want to remove the tadpole, but there are only resources for four people. Or someone sacrifices himself, or is sacrificed, or Lae'zel returns to her people. Or for a reason you split up.
Once you are past act I, you will then meet the other people in the files either permanent or temporary. I mean there is the whole camp mechanic that seems heavily enforced by Larian, where most interactions seem to happen, similar to the Normandy, or the camp in Dragon Age. So a social hub. With only three other people the whole concept makes little sense, you could have all interactions on the maps and do not need a special screen for that.
On the topic at hand: I understand, but with the camp mechanic you can easily swap people in and out. So that it is easy to experience all the interactions of people with the world. I would also like to have more companions around at any time, but this seems unlikely as the game is turn-based and rather slow in general and more agents would just slow it down even more.