Kill his cohorts, then just lose whatever damage spells/attacks you have. He's not that hard.

If all fails (potions, increase your resistances) - come back later with more levels under your belt.