I gained access too to Rayhun's fortress, but you have to know the exact location.