I have no problem with how BG3 has you meet up with the party quickly. It makes sense from a story perspective. They all were in the same ship together with tons of others. Therefore, they would all be in the same relative area.
Besides, seems to me like someone, or something, wants them all to be together. They are special. They aren't like the other thralls.
