Well that's awkward. I closed the engine for something else, made an icon change and thus restarted the Sandbox and all that and now it works just like I want. I can't think why some of the changes would take each time I changed the skill and saved and re-entered Switch Game/Editor mode but clearly something else wasn't updating.
