You can also knock them back off the platform. They won't die and the fight will take longer, but they won't be able to interfere anymore.