The casting animation delay is deliberate; there was an issue where casting a spell on another character, switching to them and moving before the casting animation was complete would result in the cooldown being triggered, but the spell effect not applying.