I have some light armor due to low strength and a few pieces of enchanted jewelry but, probably no more then 30 fire protection. But still, there's no way of fighting him when he shoots from outside the screen and through walls. Impossible to target even with area attacks. I don't remember him doing this the last playthrough but I didn't use the hit and run ranger technique that time either and my then mage had powerful spells.