Going to camp is what advances the timer, not taking a long rest. I found that out when I went to camp, got a warning, then left camp without resting.