Summoning spells only scale off of level/skill level. If you don't prioritize it your Incarnate and Totems will fall off, hard. It'll just end up being a waste of points.