Psychologically it's very hard to not take advantage of it as well. A friend and I played the first play-through together and we definitely had complexity. The second time through it was way easier because, without even discussing, we were Hulk jumping everywhere and abusing every Larianism remarking, without analysis, "Wow this is so much easier!"
That's the primary reason why the "just don't use it" argument is without merit, Larian has designed the encounters, enemies, and the environment itself around those game mechanics.
