The fight in front of the druid grove is easy(with 4 characters)...
As you near the area your character even says you hear shouting. So, sneak up the hill and approach that way to investigate. It also gives you the high ground, making it a lot easier.
You can do this fight without losing a single NPC.
