give each an attribute or two which is actually penalty.

helm = lower sight & hearing radius, longer reaction time
gloves = casting delay, reduced attack speed
body armour = encumbrance
boot/legging = lower walk/run speed

overall = lower agility, dramatically reduced chance of stealth

this way regardless of class u still get penalised for armour.

[Linked Image from i3.photobucket.com]
......a gift from LaFille......