So true OP. This issue needs to be addressed. The worst offenders are those blasted elemental fragments.

Throwing in a pause feature would deal with this issue. That way, everyone would be frozen when pausing and you'll be able to safely select an enemy to attack without having to worry about their idle animations.