You can wait until you are done with the elves in the Dark Forest and the guy looking for the vase before taking the sword.