As far as I’m aware, the tieflings only willingly leave after the goblin leaders are dead, because they know that the goblins will slaughter them otherwise.