In Early Access we sneaked up to them with a warrior and hard fisted them with phyiscal attacks, but a lot stuff changed since then, so not sure, how easy that would still go.
You probably could try to teleport a mage down, he should have difficulties to cast you from down there. Though AI tends to cheat regarding Line of Sight, so not sure.
Mainly physical team-setup offers heavy advantage in that fight.
