Interesting. I never went this way, I always kill the goblin bosses in the temple. That's quite easy with a level 4 party, take one after another.
In early access I always did it that way.
I've now beaten her twice. Once and my game crashed to my great joy, right after the last goblin was dead. But since I had the foresight to save in the middle of battle, I only had to repeat the second half of the fight and beat her again.