The checks and your ability or lack thereof to pass them will make a significant difference in how fun your run ends up being. A lot more bad stuff you can't avoid, outcomes you can't influence etc...you lose a lot of control and a lot more will go badly. Those checks will make a huge difference in how un/able you are to drive the story to more favorable outcomes.
That's entirely a matter of preference, what "fun" means to the specific player. For many, it means playing exactly the kind of character they want be playing, and that can involve treating CHA as a dump stat, and therefore dealing with the fact that they won't be able convince everyone to play ball all the time.
This in turn means that not "losing control" as you put it, is
optional. You're not *expected* by the game to stay in control of what characters around you do all the time. That's an
advantage of playing such a persuasive character, not a "must-have". Passing CHA checks all the time ends up telling a story that features a particularly persuading / lying / intimidating protagonist who can manipulate even the most difficult and personalities around them - and that, while utterly fascinating in its own right, is just
one power fantasy of many, and not necessarily what
everyone is looking for in an RPG. And BG3 has not just something for everyone, it has lots and lots for everyone, with or without high CHA.
