Code
CharacterRemoveFromParty(CHARACTER_Player2)


and then later

Code
CharacterAddToParty(CHARACTER_Player2)