In the windmill fight when they flee they just vanish. You have no chance to kill them anyway for loot or to reduce the goblin population. Monsters should flee using Dash like players do.