I genuinely am not seeing your problem here. If this game actually had people reaching to your armor that would be something else, but it's not a thing that happens. We already willy-nilly decide what our character is wearing. If the system existed then that gives me even more freedom to decide what makes sense for my character from a narrative standpoint without being beholden to mechanical requirements needed to make them effective. If say, my haracyer is given an armor as a reward for a quest that had a very personal effect on her early in the game, then I don't end up having to swap it out part because the armor can't keep up even though my character herself wouldn't actually make that choice in-character.
