This is just going to result in savescumming outside of honor mode and is no different from durability simply being removed. If you bash a door open and your sword breaks, just quickload and do it again until rng favors you. Few people are going to have their favorite sword break when they can easily reroll and have it NOT break.
I could see a sort of "maintained" or "sharpness" buff though. If you go around whacking things other than soft targets, your weapon will dull or crack. Apply some oil or find and use a whetstone to get the buff back. Not obtrusive, nor strictly necessary, but a buff for those who take care of their things and an incentive to not whack doors and chests with your sword if you want to keep the extra damage or crit chance or whatever.