In addition to the Goblin Camp example, I'd include being able to fast travel after falling down the spider hole (when you have no idea where another portal is, there are enemies between you and other portals you could walk to, and you can't climb out of the spider hole) as another example. And this is only in Act 1 of the game. These "odd situations" might reoccur multiple times in later acts, which is why I feel it's important to give feedback about it now; hopefully Larian changes their fast travel system to at the very least remove these odd situations.
The spider hole is another perfect example, I agree.