The thing is that totems are very good for summoner in the early game (Fort Joy to Early Reaper Coast) but after that point they become unconsiderable as a way of spending 2 AP, especially in a group of four due to the diminishing fire power. Even with 10 in summoning. So I think making them controllable can offer them some viability in later stages of the game more as a battlefield control option or as an undead healing ward rather than a damage dealer. I guess another solution can be leaving them as they are but changing their AP cost to 1. It will not make them stronger early because you spam them same way but just leave you some spare AP to move a bit.