NPCs don't react to killing animals that attack you; you can get a reputation drop for attacking friendly NPCs, though.
There are also reputation drops when completing certain quests (imp and orc council member quests, for example, or when leaving the castle [though in that case there is a bonus when entering that partially compensates]).
Reputation-list-spoiler