Charms need to be in the character inventory to use; alchemy and enchantment ingredients do not (I kept malachite gems on my character, though, to more easily keep track of them).