How about making a consequence for slain summons?
e.g. apply status effect to summoner that prolongs the summon cooldown, or summons progressively weaker summons (strong ones won't answer your call!), or summon has a chance of turning on you.
The purpose is to encourage keeping the summon alive via healing or buffing.
