I took this fight both upfront, reloaded and did the conversational clear of it, AND I did the sneak around and roll the boulder onto the enemy fight. I had no issues at all in winning. Whether they reached the wardrum alarm or not, i had no issues with difficulty.
So this is more a player error issue here than a feedback issue. Difficulty sliders are surely gonna come into the game, don't y'all worry.