I'd say changing the whetstone to have a fixed number of uses before disappearing would be a better idea (or maybe make it so that the # of uses depends on your crafting skill?)
Since it only adds a fixed +1 damage per weapon it isn't really OP either way.