I feel your pain, the UI and Control scheme in this game is chore to slog through even without physical detriments with KB/M. I find it very weird that they didn't enable Controller support from the beginning, since it seems like that is the intended way to play the game.
Yeah, I think if I could sink in a couch and play BG3 with a controller I would find some of it's designs much less frustrating.
