It is annoying. Especially when traversing large distances, I keep the camera on the spot I want the party to move to. When all are outside of the camera view, not only is it hard to hear what they are saying, it is also hard to see if there are stragglers.
My impression is that it is not only pathing, but also timing somehow. For example, on a narrow ledge each has to take a turn to jump over a gap. It seems that the ones that are last in line run the highest risk of getting left behind. It is like their window of opportunity has passed. I could be mistaken though.