The entrance is near the goblin enclave, but far above, with no way to reach as a human. You need to get the battle tower before you can continue that quest (the quarry tower and top of the wall will remain above the poison gas, as will the top of Lovis tower and a couple other locations).
