What ambushes are you talking about? I know there is the ambush at the entrance to the blighted town. I didn’t find that particularly hard, but once you get ambushed, running away is always an option.
Also, if you have a character with the spell disguise self you can have them walk out front disguised as a Drow. The goblins give deference to Drow and won’t attack you.
