Absolutely yes.
Only ppl who can hear dialog should be able to react positively or negatively to it.
Anyone who is not in immediate vicinity should not be aware of it at all, and thus not reacting to it.
...with exception where information is absolutely guaranty will reach that character sooner or later. As if something character focused at (his personal quest).
