Yeah it makes leveling up and surviving the later "obligatory" fights difficult when the optional ones don't offer XP rewards for getting out of them through persuasion or intimidation or what have you.