I had the same problem but in my case one of my team died and went back to camp. So when I tried to go to camp it said I couldnt. So I had 3 members that were beat up and didnt have any spells ready. But I found if you got to the map and choose the way point for camp there, it will take you there. You can then heal up and go back and the way point is actually a nice place to take on all those gobs out there.