But random encounters is not a solution in any shape or form IMO. It's just annoying filler that doesn't drive the story.
I overall agree with everything you said.
In defence of randome encounters - I don't think I have ever seen random encounters serve mechanical purpose (maybe outside grinding which is yuck). I think they could be very effective for worldbuilding, but unfortunately most cRPG are too low of a budget to flesh them out properly. I am playing Red Dead Redemption2 at the moment, and honestly it's random encounters is what impressed me the most so far - there is a lot of variation there (not just fight encounter) and ususally serves a flavour - either by reinforcing wild west setting, or continuing past story beats - like gangs you had run ins before trying to take revenge etc.
If BG3 fast travel was a bit more "in universe", there could be goblin ambushes, druid revenges, etc. We have a little bit of it in form of camp encounters already - abandoned companions showing up, Rafael's visit, Halsin revenge... Personally, I don't think it works - mostly due to camp being such an abstract location, seperated from the rest of the world. Having those encounters when fast traveling and more I think would be more natural but of course, directing cinematics would be trickier.
A bit off topic - but in general, I think BG3 could benefit from random or not so random encounters, but limiting fast travel is entirely different thing.