The confusion maybe comes from the choice of an ancient Greek term for the attribute. In the Classical period charis connoted piety, grace and reciprocity, but that was also a bit of a platonic reformulation. In his notebooks and in Twilight of the Idols Nietzsche notes that Socrates was considered bug-eyed and ugly by his contemporaries, and that that represented a kind of moral refutation in and of itself for the Greeks, who considered physical beauty to be among their highest ideals. Typically a hero described as godlike or having grace, was also beautiful, like Hector in the Iliad. Or also for figures like Arachne or Medusa before they were transformed, or after to be made ugly as a punishment. I think there is room to play with the idea in D&D like with curses, but not in a 1:1 sort of way suggested by the OP. Charisma in D&D also dances between the idea of personal magnetism and intimidation depending on character type. Probably they should have chosen a better word for the attribute, maybe the English term Will or Willpower, or Charm would have conveyed it better.
In any case, I don't want my appearance restricted by attributes at character creation, even by the 3 physical ones STR, DEX, CON which might ostensibly influence appearance. In my mind all the attributes like Strength or Dexterity or Con take on magical properties especially at the extremes, such that a player might be much stronger or more dexterous than they appear.
I would like for a wide variety of body phenotypes and facial looks, and to be able to change those at any time outside of character creation. We should have an appearance tab on the character sheet that allows us to change anything cosmetic... Heads, Hair, Makeup, Scars etc. That shouldn't have anything to do with our selected attributes