For people with accessibility issues, holding down a key and manipulating the mouse is a luxury they don't have.
I'd suggest a confirmation button before movement but I can see that annoying some people.
In the mean time, I save every few turns so that I can reload when something like that happens and I waste more than 3 AP.