I think that's the best solution, but it sounds (to me) like a lot more work - since that requires adding a mechanism of "disabled skills" to the game, which I don't think it has yet.

So in the long run that's indeed the best solution IMO, but for the immediate fix a confirmation dialog would be fine.