Easily fixed. Just give it a multi-turn cooldown.
Huh? How would that fix anything on its own? All that would do is make it take longer... you can easily sit there hidden until the cooldown comes back up. I think that would be the complete wrong approach.