Personaly i believe the problem here is the same as with "cannot reach" objects ... For some reason game presume that most objects are aproximately 1m higher than they actualy are ... therefore from engine perspective, there is no ladder.
This is hilarious.
It's a bit annoying you can't order your flying familiars & animal companions to pick up those objects. A bird getting the "can't reach" message doesn't make sense.