The problem is or at least was, that magic was far to weak compared to the damage boost the other classes gain from weapons. Mainly because there are magic resistances, but no physical resistances. At least it was this was a few months ago. Hopefully they changed it for the full release.