I haven't read the entire thread, so this might have been mentioned already, but people spawning long rest will end up locking themselves out of certain paths/interactions. The game world isn't 100% static/waiting for you.

Two examples from early access:
- the owlbear mother can be found dead, killed by another group of "adventurers".
- Waukeen's Rest event is on an invisible timer the moment you crash land on the beach.