You should definitely not have access to any kind of camp when you are in the middle of adventuring or in a dungeon. Thats just ridiculous that you can fast travel to camp while indoors. What is this, skyrim?