I think it makes more sense as a story if companions are spaced out. You get to Baldur's Gate and meet X, who hears your story and offers to join you to help defeat this Absolute cult, or to help you take it over. It really wouldn't make sense if everyone that can join was available from the beginning.
