Fort joy isn't really easy by any means. Griff or the Houndmaster will dump you if you arnt leveled enough. You actually have to seek out the turtles/frogs/crocodiles to train up.