Some players had the same questions than you a few months/weeks ago.
I don't think there is an explanation in the game and I'm not sure we'll ever have one... But we only played a small part of the story
I'm pretty sure that's because this plot-hole never occurred to Larian's writers, so there is no explanation.