As long as the game is really good about making and keeping auto saves so you don't get yourself in a lose/lose situation. I'd you push too far into the temple, say, and can't get back out without resting, you wouldn't want to have to restart the whole game.
Rethink short rest limit, make that resting away from camp, and require long rests in camps or settlements.
