There's a couple of other ways to it from memory, one of which is jumping along ledges alongside the fort, although that one results in a rather nasty fight. But there is another path which doesn't involve all that jumping.
I found a way to avoid that fight, requires the first jump, then scale down, then one more jump where the poison fog is, however at the bottom there is the random bulette. But yea the other fight is NASTY lol haven't won that battle.