If it bothers you, don't do it.
If it makes things too easy, don't do it.

You can simply not return to stealth after a hit but you chose to.

So what you really are worried about is other people doing it.

Worry about yourself and don't do it. Simple.