Just had a thought ... what if memory gets to influence the cap or overall limit of all used skill slots, similarly how Constitution caps the overall amount of AP points in OS?
Then you dont need to remove it completely, investing in skills would be as i suggest the main way how you get more skill slots in that specific skill, but memory would still have some value.
