The game differentiates between ore and gems.

It's not a bad idea, too, since you need both two enchant stuff, and therefore you can be getting two at once.

My Divinity II: Ego Draconis FAQ/Guide
My Divinity II: The Dragon Knight Saga FAQ/Guide