Memory should definitely have some sort of alternate effect as well. The difficulty is what would be good for that attribute. Perhaps it assists major attributes in reducing cooldown?
I do not believe that major attributes reduce cooldown anymore. I am glad of that because attribute-variable cooldowns make it more difficult to balance the power of skills. A skill balanced with the power of a 5-turn cooldown is much more powerful if you reduce that to 2 turns.