If they need a debuff, how about a range limit?
For example, with 0 points into the Wand skill, the Wands range is 5.0 meters. Each point into Wands increases the range by 2.0 meters, so at 5 Wand skill, the wands range is up to 15.0 meters.
If that were done, Wands would trade power for range, and thus providing a niche role for Staves as a longer-range weapon.
Right, wand might be a short range attack with a bonus spell. I would say base 5m then +5% damage and 1m range per skill.
Also apply smoke hindrance to the wand targeting.
Also apply Staff of magus cooldown on the Wands.