I guess the game could count how many dialogue scenes and battles you have done and authorize you to go to camp when you have gone through enough of them. Or if you have casualties or not, or pending dialogue scenes at camp with npcs.
It doesn't have to be a lot but it feels ridiculous when you just start a battle after a long rest, stop mid fight, go back to sleep and then resume the fight where you left it at afterwards. You can even do that several times for one battle, as long as you can sneak an escape.