Okay so far as I understand once you've been in the passage via the chapel once you cannot return.
So I went and found out where the bandit camp was before returning to accept to kill the ghost to stop the visions.
Went to the chapel and can not get back into the passage to kill the ghost...
Had a run around to no avail.
Am I being a massive nub here?