I would like for this to be the case as well, as the camp should always visually reflect that they are at rest from combat and thus have no need to wear their armor.
This should be a menu toggle like the helmets. I would find it really unimmersive on most characters to not be wearing armour at camp, you never know when to expect attack. Perhaps in later acts where we might have a more secure location, casual clothes would make more sense.