This bugs the crap out of me too. Very immersion breaking, when I played my Drow I didn't even want to go to camp at all because it just made no sense. Even if we could have a base camp that was static and temporary camps in whatever areas we were exploring it would be better than the current system. I would prefer to have a different camp for each environment altogether though. A system like in DA:I would be nice even with a couple camp locations in each area.
A minor irritation with camp is that I really would like to rearrange everything. All the bedrolls in the open like they are, especially with a perfectly good ruin nearby just makes me cringe.