Glad to see I’m not alone with this issue. For what it’s worth, clicking the ground at the top doesn’t work for me.
Yes, there’s been a problem with ladders for ages. But your issue sounds to be different, or at least worse. Normally my characters will go all the way up, and then sometimes some of them climb back down again.