Well ... I am mostly fine with this. The party leader ought to be charismatic. Shouldnt it ?
At most I would complain that some games do this aspect better and if you have low Charisma, you cannot have much of a party to begin with.
I guess my immediate answer is that pigeon-holing the player character to be the charismatic party leader mechanically restrains our choice of classes to Bard, Paladin, Warlock, or Sorcerer. Almost any other class would require manipulating ability points and skill proficiencies in ways that could bend or break whatever non-Cha class you picked. As it is, I'm resigned to playing my Paladin and Warlock, not because they're the classes I want most to play, but because of their charisma and "face" skills. In the meantime, I've shelved my attempts to play rogue, ranger, and monk characters altogether.