I would say that the difference between a fighter or a ranger with minimal weapon skill points and those with more are very noticeable.

Its just that if youre playing jack of all trades build that you deal damage with spells and also make do with various elemental and environmental effects so the weapon isnt your primary most prominent tool of dealing damage.