Along these lines there should be a way to kick a character from party without having to go into a conversation. Just a remove from party button. This should also work in Multiplayer with removing player characters that are not playing at that time.