I trust the devs more than players in their ability to make the game look good while maintaining a required level of mechanical feedback, such as what wearing Heavy Armor implies for Stealth abilities. Heavy needs to always look heavy. I don't want the confusion of looking naked while mechanically wearing heavy armor.
No one would force you to use this system, but for others it would immensly increase the immersion while not sacrificing builds and stats. Besides there are already armours which seem inconsistent like shars half plate armour which gives bonus to sneaking.
