I dunno about immersion in that regard.

We know the world "is not truly alive" as in Skyrim for example.
Even there you have obvious 'encounter places' on the map.
Something pops up there, or it doesn't. But when it does, it will always be on a certain part of the road.


When I walk through the Baldurs Gate 3 first Arc, I know nothing unusual will appear. So I fasttravel without a second thought.
Yes of course you can trigger party-interactions like dialogues by walking around, but they do not seem that important after all.
In fact most of the time I do not hear the talks starting, because my camera focus is already further ahead, since this is just how I play and I notice the voices very quietly at the beginning.

And when I scroll back... most of the time another character is already answering. ( -_-)
I wish the voices would just not quiet out at all. That is very annoying.