Nah the magic damage on a weapon definetly counts towards your magic skills
Though when you're gonna dualwield it's handy to take Dual Wield Spec Passive Skill, which increases the damage for the offhand or both hands
and otherwise it's a bug of the calculation of dualwielding with magic.
