I have to agree with the OP. I don't like the idea of memory, it should be scrapped all together. Limiting the skills we have learned to a select few limits the fun of the game. I like having all the skills I have learned at my disposal, it makes for a much more fun and tactical experience! Even the smallest skills have a use late game in some situations.