Virtually no one at this point is even arguing against the idea of "consequences", but about how these consequences should manifest specifically.
...Understanding if it was to the target's benefit?
...Annoyed if it was inconsequential, but still undermining free will?
...Angry if it undermined their free will and it was negative?
...Violent if they don't like you and you undermined their free will?
Whenever they realize what happened.
