i laughed when the Queen said she wanted me to keep him after i said i didn't want him, and then two minutes later i sent him packing. So satisfying lol. You can tell the game knew he would be annoying to a lot of players if they have to give you a contrived reason for him to stick around.
If you would have let him stay, you wouldn't have regretted it, he's one of the funniest characters as the game progresses.
