If you dismiss the character to camp, they should be kept in Wither's Wardrobe of Wayward Friends, freeing space in your party for other characters until they're taken out or if your friend ever re-joins.