My take on that is that the ability bonuses represent the "base" race and the current system already allows for RP and customization, while at the same time acknowledging racial differences. Elves are by nature and on average more nimble than humans. To me it makes sense that a clumsy elf is still more agile than a clumsy human. Similarly, a super buff hafling won't be as strong as a super buff orc.