If it makes you feel better, I lost a skill point last night. I completed the missing fruit cart quest and was awarded a point in Identify, but I was already at level 5.