I went as far as the merchants in Aleroth the first time there and left via dragon stone, did some other stuff, and returned via zeppelin (the next time I leveled), but didn't have any problems with calling the elevator.