I think my problem is I pick pocketed him and took the amulet early on. I can't give him back the amulet and he won't give me the scroll; just keeps saying he misplaced it. I guess I'm completely hosed now! Ugh...