Welcome to BG3 with its creative logic! Google "Mol BG3" to get the full picture, but in short, yes, it is as bad as you think it is. Your only option now is to load a save before you enter the hideout.