Yep, it's a hard fight.

My suggestion is to wait until you're level 6 at least before taking it, and just outside the mill, drink the best quality armor, strength, intelligence, and dexterity potions that you have.