Singing Blade: A reward for killing a thug. It's the Marcus/Trevor/Tingalf quest (Ars Magicana).
Kiya

Sword in the Stone: you can keep it if you take it AFTER solving all quests in the Dark Forest. The people there still get killed, but you've already moved on, right? <img src="/ubbthreads/images/graemlins/winkwink.gif" alt="" />

No way to kill the ghost permanently.