Did you set it to occasional? You can also turn it off if you prefered. Jess Larian did respond to a thread like this saying if people still find occasional to occur too often they will lower it even more.
Isn't the setting "Occasional/None" thing about how often your character talks when you click things? I would think that would be two different settings.
