It isn't avoiding it that I take issue with, it's that to avoid it you just; open map, teleport away. There isn't really a way to avoid it, at least I don't really understand what's going on.
Given I don’t think that all the goblins should become hostile immediately anyway if no alarm has been sounded, this is one of the few instances I’m perfectly happy to just use the teleport function when there’s not a clear path to a circle and headcanon a jump from Dror Ragzlin’s room as “the party sauntered casually out of the goblin camp before anyone found the bodies of their leaders”. Though generally I’ll tend to make sure the path to the Underdark is clear so my party could feasibly make it to the teleport circle down in the temple and jump from there, or try (usually, but not always, unsuccessfully) to sneak away, unless I feel my character would want to wipe out the goblins entirely.
Regarding other places, such as Grymforge and getting into the goblin camp, where the portals can be used to shortcut challenges, I will tend to use them sometimes and go the long way other times, depending on what approach I think most suits my player character. But as a player, I’m always interested in seeing what different approaches are available and testing them out, and the fact that some are easier than others doesn’t bother me at all. I’ll still want to see if I can pull off the trickier ones!
