What if instead of dealing more or less damage to armor to health, there were different piercing ratios. Such as (following your immersion suggestion) maces deal more damage through armor than swords, but swords deal more damage once the armor is gone etc.

Thus, you still have options for dealing damage, but are also not guaranteed to get some effects off.