Having similar. The ONLY way I have for everybody to stay together is to have Asterion as lead. Any other lead will have anywhere from 0-3 of the party follow.