Had this issue as well, the default E Settings are somehow high priority, and will be restored if you leave them blank.

Easy Fix, find some other spare key and assign the 2 original 'E' keys to something else.