Yes the key thing is that it just wastes your time. The fact that it's inconsistent with other fields makes it even worse. If I slip on ice, I alt tab out of the game in frustration and check reddit and hopefully remember at some point that I'm still playing DOS.
So no, it's not like saying fire shouldn't burn you outside of combat. It is worrisome you were even able to come up with that false equivalence.
And yes, I have walked on a body of ice (frozen lakes, ice rinks, etc.). It is very easy to walk carefully on ice and not fall, with non specialized shoes. Not sure where you're getting your info, LOL.