Regardless of your level, though, once you start whacking him with a pointy piece of metal, his spell casting rate and attack effectiveness drops, especially if you have Stun (or Poison, or Frost on the weapon).

The shadow potion / spin attack trick will make it an easy fight.