I played 2 playthroughs without putting any points in memory, raped through every fights and never felt the need to have more skill slots, just use a varied party if you want versatility. For the Early Access, this stat is useless.