+magic seems to only count towards the damage you do with the weapon. Spell dmg appears to be based off +int [and whatever level of spell you have].