This could be explained by the tadpole uplink conceit, or even more sensibly, we could just assume that everyone at camp is basically the B team in the rear, always arriving late but essentially participating in every encounter and every major story beat. That idea might be strengthened if we could summon and dismiss all our companions from a simple menu without going to the camp, or having everyone in the major cutscenes, like Swtor style. The way they have created the camp, is basically like the ship in Kotor games. It doesn't have a helm, but I suppose someone could pull out a map, and point and it'd work the same way. Then you'd really have to decide who you're taking on board though, since the whole game isn't split up into factions, and presumably the camp would get too large to feel like much of a party anymore if its just all in all the time.
