I did the quest both ways (having saved before entering the cave), and then reloaded to kill the goblin leader (the quest reward is better, and killing Aurelius is a tad evil).
Svadilfari will just attack you after you complete his quest, and has no reward for you, except the chests that you can loot either way.