They're not taking physical armor damage, that should tell you right there. The damage itself is a giveaway; Battle Stomp does way more damage than a tick from environmental effects. And lastly, the combat log should give you an answer.
Long story short, no. You're not directly hitting them with it.
