If you retrive you stones do you get exp for completing that quest?

If not then i wont take my stones with me beucase i notice that if i dont take my stones with me the imp doesnt appear.