I kept every charm I found in the entire game until I reached the Wastelands. They weigh nothing and you can sell them in the Wastelands to buy more gold charms!