The only really really hard fight is the one involving the minotaurs. Some spoilers - after that go to the plant people camp and recruit the fat plant guy that can resurrect dead things and use him to resurrect the minotaurs. Instant win in everything.
And even minotaurs can be really easy if you rember to call the ogres.
I actually never tried that. That might be true. Granted, if you want to beat them without Larian shenanigans it is a hard fight. The best solution is to separate your party as much as possible. Grease is also helpful