I agree. I feel if you are on the open world then fast traveling to camp and resting is perfectly fine but in Dungeons it seems kinda weird to go to camp and then start right back in the dungeon where you were.