Well true, low Charisma can also mean you're abrasive enough to get bad reactions out of everyone. Then you just need to follow through with it being empty confidence. And Lae'zel gets a bit annoying with the superiority.

Wyll being witty and amusing could be the fail here. If they think that's enough to make him charismatic, they're thinking too small. A high charisma character will also be abrasive when that gets the desired result. A high charisma character just IS someone who commands respect and attracts followers. It's attitude, behavior, confidence, social skills, everything. Not just a one trick pony being good at sweet talking. People who are witty sweet talkers but not charismatic are quite obvious, and their schtick gets old fast.