On the way to the harbor from the starting area in the fjords, there is a relatively narrow mountainous island. Fly up and east of the depleted ore mine, then follow the mountain north east. The teleporter entrance to the fortress is right across the water from one of the 'Reaping the Seeds' quest trees.