After turning in the cure ingredients and dealing with the shaman, the spider farmer should be dead (along with most of the imps in the village, particularly quest related ones).
You could just skip the quest; you'd only be missing a bit of experience and a poisonous dagger as the quest reward.