That happened to me once using Boulder Bash on a couple of the guards, but I think Bruthor was just barely inside the area of effect, so between neutral and friendly units, the neutral one went hostile.
The guards were all dead by the time I freed the other prisoners, so they all just ran away.
