Whenever I scroll away from the combat to catch a glimpse of NPCs moving back and forth and spamming their idle conversation lines, it breaks the illusion that turn based reality is time-frozen, and makes me see it as "these few characters are for some reason standing and waiting instead of fighting", and I don't like it.

Why should turn basedness be localized anyhow? It just complicates things.