This happened to me as well. I assume that the current Silence spell literally only prevents verbal spells from being cast inside it but doesn't prevent noise from being created in the bubble. So the cracked wall can't cast a verbal spell, but it can produce noise when hit. Hopefully this gets patched in later on since Silence adds alot of options both in and out of combat.
