Hmm, you are supposed to keep them. And I can confirm this for version 1.42. Which one are you playing? They are in your misc inventory.