I haven't read the entire thread, so this might have been mentioned already, but people spawning long rest will end up locking themselves out of certain paths/interactions. The game world isn't 100% static/waiting for you.
Two examples from early access: - the owlbear mother can be found dead, killed by another group of "adventurers". - Waukeen's Rest event is on an invisible timer the moment you crash land on the beach.