I think having certain areas restricted from fast travel/long rests and increasing the number of "daily" short rests (2 or 3 probably) would solve my issues with the current implementation. A day/night cycle and a clock/calendar would be great, but it might not easily be implemented.
