Praying on altars in Driftwood doesn't close the quest. It is said in the web that you need to talk the scarecrow in the field. But it is hostile from the start so by the time I open all altars the scarecrow is long time dead. And even if it was alive, people say it attacks you anyway.