Charm Quality does not boost the Charm skill. Charms are what Larian call things that can be socketed into equipment. That means that you can socket one bonus-granting item, called a "Charm" into that piece of gear.