Maybe you'd have to get through a few anti-dragon shields, or would be too conspicuous in dragon form...
You don't need to get to Aleroth quickly. There are a couple merchants there you may want to get access to early, but the quest there isn't time sensitive and would be difficult at lower levels if you did rush.
