You have the sword in your inventory - not equipped, right? If the stone glows again, then drag&drop it on top of the stone. And you must stand near enough, so the stone is highlighted in grey.
Kiya