You do get the skill points back if you unlearn a skill, so can re-invest them in a different weapon expertise or more powerful attack spell, etc (or leave them un-used for later). With a mage character, for example, more powerful and mana efficient spells (particularly shaman magic) start to become available in act 2, so there may not be as much use for the attack spells used in the first act.
