I have not done this fight but what you describe reminds me a lot of the defensive statues in the cave under the Druid Grove ...
Also,
There is no challenge to this fight, aside from struggling with the control issues and tedium.
I will, once again, emit the wish that Larian will take notice of how often the words
controls and
tedium (in their various forms and derivatives) appear in players' feedback. And that they will decide to do something about it, of course.