Basically Larian only wants, or rather, only has the time and resources to make reactive worlds go so far. If they had him go to the camp, next you'd want him to go with you onto the ship, etc.