Non grouped party members seem to get stuck in the smaller camps when you rest there and then rest in the big camp. Ive found if you rest in the same cave, temple, etc they disappeared they will still be there. Though i havent found a workaround for it.
