This might sound a tad stupid but have you tried dragging his portrait over your other character's portrait? When a character is assigned to a different player, he doesn't follow anyone automatically and you have to do what I just described in the previous sentence
