No, you would not sacrifice naything,. all skills are interchangable between the classes...
I would get sword expertise...there are some good swords further on in the game...
Also, for a mage - max out meterstrike, it helps you far into the game, and has a low recovery time.