The tooltip on the gloves for MAD links to crown of madness. The spell that impacts summons is demon spirit madness. The difference is that the tooltip linked in the description says summons won’t attack the spellcaster when affected. On the basis that it is suggesting crown of madness will apply. When in fact the summons are affected by demon spirit madness which makes them attack the nearest creature.
