So instead of helping Gavin right at the beginning of the game, I've cleared the whole act1 beside the final boss and decided to help him teleport to the other side....
After following him around, he finally end up dying where the voidwoken demon was located... even though I've already cleared the place...
Would have been nice to have him go to the base camp and linger there instead...
Basically Larian only wants, or rather, only has the time and resources to make reactive worlds go so far. If they had him go to the camp, next you'd want him to go with you onto the ship, etc.