Might be too difficult to gauge and implement, but there should be a limited number of long rests you can take before the bug in your head takes over. Maybe warning signs along the way and/or incremental changes to the characters (or Con checks to resist these small changes).
