I've been thinking about it for a long time and the best way I thought about "fixing" it with the least change possible was:
- Keep the 2 points per slot.
- Give 2 free Memory slots every 5 levels.
- Rebalance the skills that need more than one slot. They already cost more action points to cast, not to mention the ones that need the extra source point.