You're also a total squish monster. No points in willpower? None in body building? You're susceptible to a huge number of status effects that result in you being completely useless. In a mage duel you will lose as he resists your effect and then charms you under his control or knocks you down in a pool of fire. Or freezes you. And as mentioned you aren't a specialist and will never become level 5 in all of those abilities due to scaling costs. If you end up wanting to develop defensive abilities as you lose to archers/rogues with crowd control your spell casting will slip further behind as you become spread too thin. You rely on teammates for communication, crafting, etc. You're a mage and nothing more...which is a fine archetype!

The game is nearing a very good balance between the advantages of versatility (More situational offense, more variety of actions) vs. the advantages of specialization (Playmaking higher tier skills, more room for utility/world interaction skillsets, defenses)

There's a tradeoff in all things.