I think you can use Calm Emotions against being frightened. I was lucky so far , but in my current HM run, I gave to face him again soon and I will pack CE and all the adds , that I can. If necessary from scrolls.
"We are all stories in the end. Just make it a good one."
