There are numerous ladder glitches in the Blighted Village (and elsewhere) as well. I've taken to using extra steps to click on ladders themselves instead of trying to let the game pathfind for me.