I found this comment on reddit which makes it seem that you can still enjoy the game without CHA:
I've done many playthroughs of early access . . . and I can honestly say my favorite was with a low charisma Barbarian who tried to be helpful but ended up failing most social interactions! It was hilarious.
You really don't need to pass the social interactions to have a great time. Sometimes the failures actually result in better outcomes . . . and are often funny.
Just go with it and enjoy the experience!
But personally I wouldn't like constantly failing all the dialogue choices in my first playthrough as I want to discover as much of them and the outcomes as possible. After I'm familiar with the game I'll run through other non CHA classes in future playthroughs.
If you're ok with failing the dialogue skill checks on a first playthrough, you can go ahead and play the barbarian. I want to fully abuse friends and charm person and max CHA score on a sorc for the first playthrough.