It should work AT ALL.

Ive had enemy spellcasters stand in my aoe, use voice lines to call for reinforcements casting spells in my face while my people couldnt cast anything at all.

Ive also had an enemy cast silence and while in his own bubble still able to cast spells..............

Seriously, does it effect anyone other then the player?