Partially it is because summons don't appear that early in the game.

Well ok... I fully expect master summoner to have a level 1 summon skill...

But the last summon skill we had was a broken fire skill that took 3 memory and 1 sp