I'm not sure, but I guess you have to talk to the spirits there for that to happen.
It's possible I didn't do that, but since this was an official bounty from the Paladins, the expected thing is that Paladins provide a reward. They're not going to say "jolly good now go talk to some ghost somewhere for your reward".