Seriously, do you actually think about the flavour of racial ASIs after like, level 5? Is that what you think of when you think about why you want to play a given race? When I think about 5e elves I'm not thinking about what stat they get +2 in, I think about the fact they don't sleep and thus can't be put to sleep magically, or the fact that their darkvision is a result of them being able to percieve the weave in a way other races can't. That's the mechanical stuff that provides real flavour, and if the game went harder on those things, then losing ASIs wouldn't be nearly as big of a deal. For example, what if elves also got a bonus to being able to identify spells being cast thanks to their weave sight? That's incredibly flavourful. Half-orcs are a great example of lots of flavour in their racial features.
I think Pathfinder 2e does it right, offering each ancestry(their term for races) a selection of racial feats that they can choose from every handful of levels. It guarantees that even without racial ASIs, an orc wizard and an elf wizard would bereally unique, and in fact would probably be built differently to take advantage of those ancestry feats without needing further encouragement from pre-set ASIs.