What timekiller said: It is your PoV, so if you play Durge, that is Durge - and that doesn't make sense.
Its not only Durge. Where would that ship have picked up Astarion? Or Karlach? Wyll?
The latter two only boarded after "you" were tadpoled during the hasty escape during Avernus. And Astarion would be in Baldurs Gate (not the city in the cutscene), only come out at night and hard to move without being tadpoled first thanks to his condition.
And as the ship had a specific, high risk/value mission why would the drag untadpoled spares along?
That is where the speed tadpoling jokes a few posts above came from. I have no idea, why the Illithid would bother to tadpole Wyll and Karlach in a crisis, even if they wanted to find and tadpole them in the first place.
As for Astarion: honestly, he doesn't makes lot of sense, neither does BG based Tav. There is no mention of an Illithid ship over BG. Of course they could have been handpicked and abducted by cultists, but why some low vampire spawn and a nobody? In Astarions case, I would say the changed Cazador plot might be the reason, it doesn't make any sense. Without that ritual, he could have been sold to the cult by Cazador for a favour or something like that.