And in that scenario, what is the function of the other 5 points you start with?
10 is race baseline. At the baseline you have 5 memory points.
Done.
It is far more important that the game works then for it to be elegant.
If a blunt force solution is required then it is required...