I'm just brainstorming here; I'm not an expert. Here's some things I'd check and fiddle around with.

Is the platform your character on marked as walkable?

When you make the AI grid visible, is it green under the platform or on top of it?

What happens if you rotate the ladder 180 degrees?