IMO Wands and Staves are there for "Early Game" when a caster doesn't have enough spells to fully expend all their AP on, and then late game, like others have stated.. they are just stat sticks.

If you want to "Direct Damage".. get a Bow/Crossbow. Casters should be doing AoE's and Crowd Control.

Also, thanks Sotanaht for the wand core names.. I''ll be updating the wikia shortly.