I would like for this to be the case as well, as the camp should always visually reflect that they are at rest from combat and thus have no need to wear their armor.
This should be a menu toggle like the helmets. I would find it really unimmersive on most characters to not be wearing armour at camp, you never know when to expect attack. Perhaps in later acts where we might have a more secure location, casual clothes would make more sense.
I couldn't agree more on this here, after all, when your out in the open you never when or what might attack and you can't be too careful.
"Sleeping in light armor has no adverse effect on the wearer, but sleeping in medium or heavy armor makes it difficult to recover fully during a long rest. When you finish a long rest during which you slept in medium or heavy armor, you regain only one quarter of your spent Hit Dice (minimum of one die) If you have any levels of exhaustion, the rest doesn’t reduce your exhaustion level.""
That is from Xanathar's Guide to Everything (page 77) and I thought it makes a lot of sense. I believe it is an optional rule.
Now, most of the characters use light armor, but my suggestion is mostly about the scenes that are awkward with armor, such as sex scenes and the dream sequence. And the vampire bite scene because Astarion can't physically actually get to the Main Character's neck. I describe the specific scenes I think suffer from awkward armor in my original post.