I thought it meant some sort of negative status effect.
Check that your character isn't poisoned, weakened, or some other thing next to their portrait.
Usually it does. But it tends to stay on after fights with certain characters, long after the effects are gone.