I mean, the turn duration would be almost identical. The only difference is that they are standing still instead of walking/attacking.
And you are taking no punishment at all, on the contrary, you are getting advantage all the time.