The Mysterious Cave is accessed by a ledge on a mountain near where the path from the depleted ore mine splits off to go the harbour or High Hall (D2:ED fjords map, which is essentially the same in DKS).