Magic Damage stat is for weapons. This allows high INT characters to do good damage with weapons that have Magic as their primary damage. Or STR/INT characters to be really mean with 'Balanced' weapons.
Edit: Overall it is your LEVEL that is most important. Kill everything, do all quests ... WIN (well kind of ... ending grrrrrr.....).
