If your party is full, talk to the character, you want to dismiss for now, choose the 'I want you to stay in camp'-option and they will leave the party and go to camp. Then talk to the character, you want to have in the party and tell them, that you want them to accompany you and they join the party.