Have you tried 'fast traveling' to the camp instead of clicking the 'end day and camp' button?