This is the "white room" I keep hearing about, people who think dice probability should dictate how they build games and the people who populate them. Why not just have every encounter be everyone in turn taking a swing at each other, add in modifiers for each spell known, make a computer program that will do it all beforehand and you can roleplay the outcome it came to, that's the game is when you boil it down, just a finely tuned engine for damage output.
So far your only justifications for making ability scores race agnostic is that it lets your players disregard any kind of constraint being a certain race might entail for the purpose of min/maxing your class; the other is that for some reason treating elves as inherently more dexterous than humans is an artifact of racism from the 30s, folklore and fantasy are just the projections of ignorant people after all. Why not just run a Sci-fi campaign, everyone is human, but this fellow's grandparents liked to gene splice in pointed ears. I bet they've made a Mass Effect tabletop game, are Krogans being massive four testicled berserkers also the specter of racism, should stats be race agnostic in space?