Can you get back in through the exit near Jackson's farm?
I mindread the prisoner, so didn't get the cave-in (done that way you meet a couple other bandits there just after they break him out, and can either let them go or attack them), and the chapel entrance remained open.
