Normally they're supposed to stay with you (they only vanish after A3). Are you sure the stones weren't transfered to your other char?
And have you installed the latest patch? (I believe this was a bug that is supposed to be fixed)

I used to be snow white, but I drifted... Check out my Beyond Divinity fansite