I think something that all those games have in common is that they are all to some degree or another, very much ABOUT being able to be evil. With the exception of Kingmaker, being able to play a properly evil character is very important to the experience of the game. In most rpgs you do have a central story that you have to get to. And there's only so much flexibility you can give in interacting with that story until the story itself falls apart. And those stories typically are made under the assumption that the player is going to be pursuing a good goal. Saving things, stopping another evil, etc. So evil paths are included out of obligation as much as anything else. Often really evil, selfish people wouldn't have much motivation to pursue the story in the way the devs have created it. And you can say "well the devs should do more to accomodate evil choices and make them complex and satisfying" but the thing is, that's not the story they want to tell or are trying to tell. And more often than not trying to accomodate more evil would lead to both sides being diluted.
Now where Tyranny and WotR differ is that providing deep evil paths were, from the beginning, a design goal as important as making quality good paths. The evil paths are part of the story that require a lot of focus and effort. And even in Kingmaker, the story there lends itself to evil very well - after all at the core of it, you're trying to attain power and authority. The constraints of the story there are that you always have to be working to keep control of your barony, which isn't something that will conflict with a lot of evil characters, so evil choices are easier to make work. So my thesis is that unless the point of the game is tied in with being evil, then the evil path just istn't going to be as fleshed out in most games.
Oh personally I feel if the developer can't make the 'evil path' compelling/narratively satisfying in the parameters they set out for the game, they shouldn't include one and use what they otherwise would've allocated towards the mustache twirling path to make the 'main narrative path' more engaging and increase the feeling that your choices mattered in it. I just like it when the paths in a game are well written and don't fit awkwardly within the larger narrative. Luckily BG3 seems to be trying to make the evil paths feel deeper and less arbitrary.
