Yes they give you a gem, not sure what kind. Also I believe you can find apples in many places in the village in Broken Valley. Try the Miller's place for an apple, I believe there's one on a table in there.