I agree, this is extremely annoying that you can misclick because the idle animation. Biggest issue where I had this was fighting
King boreas, he summoned the elemental fragments which will go from sitting still to spinning in the air above where they were originally. So you can click just as the animation starts and run instead of hitting them, so you have to wait until they do the spin, then zoom in and click quickly or they will spin and you will miss