I've noticed that as well, but it only happens for me if I change party members when I'm in camp.