The biggest downside to wizard is that there is very little reason to go several levels in Wizard. You only need 1 lvl to get access to every wizard spell in the game.