Agreed. The people who are claiming that have obviously not played over a dozen characters with different combos of race/class/backgrounds. If you want to be a chatty wizard pick up the friends and charm person spells, which is more in character for most wizards anyway.
If someone in a D&D game said they want to play a charming wizard, I'd tell them to play a sorc rather than make a wizard with decent CHA. I would say the same thing to a BG3 player.
