Yeah, I had the most challenging encounters there too. Except for one "funny" one with the minotaurs. I was sneaking around but didn't decouple shadowhaert (she was sneaking too). But she was seen. So, they - quite literally - jumped me. But "tanking" with Wyll (down -> get up with help -> down -> get up with help -> down -> ...) kept one minotaur busy - wasting his actions - which won me the fight^^
But the bulette - for instance - gave me quite the headache.