There are many ways to allow a goblin to actually enter the grove, one of the biggest being that they help the people outside the grove and therefor a few would recognize them as not "the bad kind" but there would be challenges and consequences.