I thought it meant some sort of negative status effect.

Check that your character isn't poisoned, weakened, or some other thing next to their portrait.