Happened twice to me so I just left the quest unfinished.