It seems that if you select a race that starts with medium or heavy armor proficiency, you can actually wear chain, plate, etc, as a level 1 Wizard/Warlock/etc. Likewise, you could also theoretically pick up the armor proficiencies during feats every 4 levels (right?)

Are there any drawbacks or penalties to casting spells or wearing heavy armor as a wizard? In my initial testing it does not appear to be. That seems to make playing something like a Githyanki or Dwarf a huge advantage, as your INT can still get almost as high but you can walk around like a tank. In fact, could you use a shield as well?