Choices that avoid fights typically result in receiving less XP (The only occasion where this is not the case that I can think of is
the back alley trader in Hunter's Edge).

However you usually can just kill them afterwards to max the total XP gain (except
the stone guardians in front of the church and in the Knight's Tomb).