Not kicking down, dealing them a blow which pushes them back. And since the conversation with Lord John starts as soon as you climb up the ladder, this means you are fighting on the edge of the trapdoor. So... one blow and you're down... literally. And I have the same problem, stuck with a force field, inaccessible ladder and reloading does not help.