As long as this was an optional setting, perhaps with frequency toggles like the annoying point and click voice has. Otherwise I can see this as being rather immersion breaking.
My characters tend to be silent especially in hostile areas. One may mumble or quietly swear a bit in Infernal on occasion but not when silence is a necessity.
