Assuming you aren't tossing the smokepowder bombs at the rubble and have talked to the sergeant about it, simply place two small bombs right next to the rubble and blow it up after everyone cleared the area.
In Early Access there was a bug where them walking over the fire left by the bombs would turn them hostile, but it's been fixed in full release as I had the gnomes walk over it and they remained friendly.
