That's not accurate, as both times I started out, I left via Rift Travel, and went back the same way (after discovering the second stone). I was able to access the Hall of Heroes without any problems.