I drop them as soon as I use them.

The problem is when I don't know if I've used them yet or not.

Same with other quest items. At least make them "de-quest" with regard to colour when they're used, so I know I can ditch them.