Yes, you need to have charms in your inventory to be able to use them.