Yartar is near Waterdeep (a little north of it), so I think that's where the ship must have grabbed Gale.
Gale mentions that he left his tower after running out of artifacts, so it makes sense, storywise, that he had started traveling northward from Waterdeep toward unpopulated territory.