Yeah, thought the same thing several times during my playthrough. Not sure how much one would get behind in xp if one went the diplomatic route as often as possible, but it simply feels wrong.