there must be a bug occured in your run. He will still be there even if you beat Dallis and Bishop at Fort Joy before.

Youtube