It doesn't matter where you leave the other teleporter stone, you just need to be able to teleport back out. I had the armour in my inventory (and looted everything around there) when I entered the easter egg area, so you do not need to wear it.
If all else fails;
Teleporting Anywhere, via hex editor.
