A hermit asks you to kill the Stalker in the cave the silver armour can be found in, but I don't recall having to do anything specifically for the silver armour quest.
Someone once reported that they needed to wear the silver armour, though that is not usually the case. Maybe try equipping it, if you haven't already.
