The simple answer, the kind of DnD games more similar to BG2 or Pillars of eternity we would like just plainly DONT SELL massively.
That LARIAN TOUCH on this top down RPG genre gets very wide appeal and easily stretches to consoles; A couple of focused companions story (all of which are easily 2020 relatable...), cinematics, fun silly gameplay, green/blue/red/yellow items everywhere........all of this sells more than DnD mechanics, numbers, day/night cycles etc...sadly.
I mean if BG3 had only 4 classes, Rogue, wizard, warrior and cleric, the majority of people wouldn't really mind nowadays. Even Cleric and wizard spells have kind of merged together now. BG2 had 118 unique cleric spells. 185 wizard spells...Thats no typo. The total game had nearly 300 spells.
Yea you dont use all of them, but it just add so much lore and flavor to the game.
Get a dozen Larian and Obsidian guys to work on a side project. Thats how we could get an incredible BG2 flavor game

And ABSOLUTELY LEAVE WOTC/Hasbro OUT OF IT.