When you enter the bandit prison cell through the underground passage, an auto cut scene will be triggered. Then all you need to do is just get back down to the underground passage and get out from it, together with the bandit.