It should work, but would kind of be a waste of skill points, IMO (especially with Frost, since it ignores the target's resistance, and always applies).
Poison Weapon can be quite effective, especially early in the game.
I found Stun quite helpful, and eventually maxed it, after buying a weapon with that bonus shortly after getting to the farmlands. I didn't invest in the passive elemental damage skills; early in the game they don't get triggered very frequently, and later I didn't need the extra damage. Having elemental damage bonuses on weapons is nice, but after the base damage I went for primary stats and HP/mana for bonuses, when available.
Note that mixing any 2 of Frost on a weapon, Stun on a weapon and the passive Stun skill can sometimes result in creatures hanging in mid death animation, and not dropping items or giving experience. An area effect spell that doesn't need a target, such as Hell Spikes, can force the animation to end. Some people also reported that waiting a bit or sleeping would also work.
