D&D does have that system. They also apply it to walls! Of course, stone walls can't be taken down without several hours (if not days) of pick-axing. It really would be quicker, and more interesting, to adventure to the other side of the wall.