You don't actually have to fight him at this point.
If you lure him out of his room by running away, then drink a Shadow Potion he stops. Go around him and go to where the Stone Axe is. As soon as you find the room with the axe, he admits defeat and leaves.
