They fighting Drows too, especially the Tieflings, but they let you in, if you playing a Drow.

If they see, a goblinoid killing the attacking goblins, it will be the main reason to let you enter the grove. And yes, they will be warily and you have to suffer some disadvantages.