"Indomitable Will".
Which has nothing to do with spell damage, BTW. Indomitable Will helps you resist certain spell effects.
INT has an immediate effect on all magic damage, including spells and weapons. It may be that you are fighting enemies above your level, and they take less damage due to level difference. If you were fighting enemies of the same level as you, you would see noticeably higher damage numbers.
