Sure as long as the base camp / house / castle isn't the only place for resting.
It's already weird in EA when you teleport in and out of the Underdark to rest in your forest camp that's not even actually on the map. It bothers me that you don't even know where you camp is exactly. It feels like a pocket dimension rather than a real location.
Later it's only getting more weird if you have a house and the travel distances for rest between locations and the "camp" are even more unrealistic.
And all of it would be solved by letting us do local long rests in whatever location we are in. That would also be much more in the spirit of adventuring.
