Sometimes, you can talk your way out of a fight (which would have rewarded you with EXP for killing). Charisma EXP helps offset that kill EXP loss to encourage you to play how you want.