For me this feature would just be annoying, pathfinder kingmaker had that and It was, for me, a nuisance, in a game where you have to manage resources and time os one of them having enemies interrupt your rest, do damage, cut you out while traveling, was obnoxious. And once you were strong enough those encounters were just a pushover and a waste of your time.
That's How I felt about this mechanic, and I feel like here It would be no different