Also, I get the worm argument but even with the worm the player doesn't hear others' thoughts at all times. The player has to specifically focus and try. I doubt the other characters are investing all their mental energy into being in the player's head at all times when they have their own stuff they're dealing with.
