In one of runs, I killed everyone without the Void Worm spawning, then was able to walk around freely. Once I walked out into the open, the Void Worm spawned. I think it's an area trigger. If you don't walk into a certain area, it doesn't spawn. So, if you fight solely from the sides, it won't spawn. I can't currently test this hypothesis, though.
