If you can't sneak out/fight them - just use the fast travel icon (small tear drop by the map) to go to a different portal.