No I have visited the camp just as much as my first playthrough, and then he showed up after like the second or third rest. I have done a lot more than that now.