I'm sorry I'm confused. Did you pick it up when you teleported to it the first time? Then you used the portal stone on the floor to leave with it?

~DragonQueen~