If your party is full, talk to the character, you want to dismiss for now, choose the 'I want you to stay in camp'-option and they will leave the party and go to camp. Then talk to the character, you want to have in the party and tell them, that you want them to accompany you and they join the party.

"We are all stories in the end. Just make it a good one."

Doctor Who