Could work. Traditionally, Wizards are meant to have low armour for the reason that their spells are so powerful. They should use magical means to off-set the damage.
Perhaps an expensive light-weight armour or one that provides a spell bonus in Shield spells.
