If you leave a teleporter stone behind, an ancient pyramid will be placed in a relatively hidden spot near the start of the wastelands. If you use the one in your inventory, you will just be teleported within the wastelands.