I agree. The whole idea of a camp, so you can have a place to go back and flesh out during the course of your adventure is nice. But I'd have rather have it as a true world location where you had to travel. Adding instant travel could have been done with mage spells later on, teleportation circle or something like that.
If it is a camp at the location you are, it would make more sense. That would also allow for easy ambushes. Sleeping in a skeleton invested keep could get you awoken in the middle of the night by an attack. Perhaps a 'watch' mechanic could be implemented aswel.
