That would be nice. As a general rule, killing a yellow outlined npc = oath broken. I got that one time when I threw a bhaalist assassin into a chasm.

I think if you talk to them and then click attack, it's okay. Must try.