Yeah, I did this too the time I played a Warlock long enough to reach the understark. It's certainly enriching.

The reason Äldritch Bläst does extra damage though is because it doed Förce damage and the crystals are vulnerable to that.

Optimistically Apocalyptic