I haven't played for a while, but I seem to remember there being a Leave Camp button that takes the whole party back to where you teleported to camp from, as opposed to selecting a new teleport location from the map which only sends out the character you've got selected.
