What level are you? He is pretty hard, maybe level up some first...
My sword did 100 damage or something like that...