Nah, the human foes all have their certain rightful point of view. Not just the factions, but you may even make friends with the lowest of criminals and pirates. Of course, the animals and the lizardmen attack you on sight, but I doubt they lack reason to slay humans. 'Sides, anyone would be cranky after spending countless ages buried in a temple.