Are you in the right spot, the house across the road, south west of the church?
Are there any green crosses on the mini-map nearby that may indicate where the prisoner could be?
If you talk to the bishop again and go through any available speech options, does that help trigger the appearance of the prisoner?
It should be possible to
hex teleport the prisoner back to where he should be, if nothing else works...