Just my two cents, but I'd think it would be more immersion breaking if people were dragged into every convo the other player initiated.
On a side note, this thread reminds me of a thread that occurred while Sword Coast Legends was still a thing, where people complained that being dragged into every convo was immersion breaking. Each to their own I guess.