Were you using your main character at the time, or still controlling one of your companions after a fight? Because they'll usually talk to the currently-controlled character.
I don't mind this at all, personally. If that happens, I RP the answer as the companion would answer it, which sometimes leads to hilarious results.
