As I remember he starts out the party with insect swarm or something like that. Spells like that are useless agains enemies with high armor rating so just make sure you have some heavy armor (and rings with high armor) and you can walk up to him and kill him with no problem.
