Considering the whetstone buffs your weapon stats, it's not really surprising it's a consumable.
Limiting it to one use per weapon would be a bad solution because then everyone would use it on each and everyone one of their weapons, turning the whetstone into an annoying and compulsory timesink.
I suppose modifying its appearance for one of a pocket-sized whetstone would be the best "fix".