They should either be a 1:1 ratio on memory, or rebalance how much memory a skill costs, imo. A lot of the source skills don't make any sense. They cost a scarce resource and large amounts of memory (walk in the shadows doesn't make sense as a source skill especially in its current state.
I also have trouble warping my head around how a summon skill book costs 3 memory when you plan on adding a summoning class in the game that's supposed to use multiple summons, detonate them, heal them, and siphon health from them to heal the party. Unless they are planning to make it where intelegince and other other stats not effect how summons will work, and make it purely based of player level, which I personally consider to be a really boring way of doing progression.