Same happens to me (on any mode or difficulty) if I give Wulbren the hammer, but kill the guards first, or kill them before Wulbren reaches the tieflings. The gnomes will just stand there and I have to break the wall myself to make everyone move. I think they get confused when out of combat.