Have you played the latest patch, Clawfoot? I only tested it a little bit myself, I'm currently waiting for new classes and whatnot to be added before I make another deep playthrough, but what I want to say is, when I tested the freshest version the environmental/surface damage seemed to have been diminished a bunch.
