Are you able to open the map and - on the far right with other waypoints - select "leave camp" (or something like that)? After a long rest I always have to leave that way.