@Acemath : You play on pc or xbox?
One time I have also this problem by the ladders on the Lovis Tower, but I think I did something wrong with my controller (I paly on xbox) ... After that, no problems at all!
Maybe a solution? >>> When you're at the top of the ladder, use "the button/lever" you used for walk/run forwards when you're at the top of the ladder...
Give it a try ...
It would suprize me if this is a "bug"!
I hope you find a solution!