A save/reload does fix this, as does simply removing and re-adding the skill from the spellbook.
For the bug to kick in i first have to use the skill once, then pick something up which fills whatever slot it was assigned to.
No idea what causes invisibility or the armor regeneration to stop working.
Will upload a save.