Sometimes I think it's whoever is closer to the person. Just experienced this with that tiefling by the telescope. Finished the fight with the bugbear and she started talking to Gale. So I reloaded and made sure I was closer. Moved everyone else.