I like the changes proposed by Swiftwynd. There is a matter of fine tuning so memory won't become useless. But the 3 ideas seem a nice change.
The main problem with the system in place is that you are forced to put all your points leveling up on the main attribute, or else you become weaker. If this is corrected, even the system in place would be quite nice.
