By design
"interact with nearby objects while" translates as you can't have them when you start listening in


Luke Skywalker: I don't, I don't believe it.
Yoda: That is why you failed.