It just kills the fantasy of being a necromancer... Back on 3.5e, animate dead had the rule which you can control your caster level * 2 hit dice of undead. So your lv 10 necromancer can control 20 hit dice 1 skeletons, but could't control 4 more powerful undead with more than 5 hit dices.
All games which features it has mods which removes summon limit " but you cannot control more than 2*Caster Level HD of undead. Those in excess will be removed from your control."
https://neverwintervault.org/project/nwn2/other/warlock-reworked-102g