If you leave the tower through the lower door, you'll see some defense-fortress in front of you (you have to fly there as a dragon). If you cleared that, you have to climb up some protusion, where you'll find the back-door to the mines.