Something similar happened to me in the Hag's lair. When I got to the ladder past the waterfall I couldn't go down. I got a "Can't reach" message and had to jump down. When I tried to go back up, my character climbed the ladder and then immediately moved down with no animation, he just floated back down and through the ladder, ending up behind it.
