It's been a while since I played table top DnD but every time we heard the DM rolling dice while we were exploring we thought maybe we should be more alert in this area.
I like seeing the Perception checks. This is a clear example of how badly we need the "Difficulty" setting implemented in the game even during Early Access. "Normal" and harder: don't show checks. "Relaxed (or whatever)" and easier: show the checks.
I used to randomly throw dice or flip through my notes as a DM just to confuse my players because of exactly what you described.
Setting options would be a good solution.