What if they implemented a random encounters at camp feature where while you are adventuring your camp might get raided by bandits or animals that smell food, etc. This, a reason for leaving party members at camp. Party members at camp are then drawn into a fight to defend the camp to keep supplies from getting stolen.

So, best to not leave ALL your goods at camp, because you never know when thieves or wild animals might raid it.