Reddit to the rescue, found out about the "Toggle armor visibility" button. For some reason that apparently gets unchecked after a character has died and been ressed...