as someone that plays a Magus in Pathfinder. my default armour is. a Silk ball gown topped by a lovely coating of Mage armour and backed by a generous side dish of dodge and dexterity. throw in a dash of Mirror image and a Caster class character is an evasion tank. and get to wear whatever clothes she wants.
But that is't the point of this thread. the question asked "Why do wizards have to wear robes"
A: So the enemies know who to geek first.