No matter how I tried, it did not work. The portrait can be moved only by the host of the game (ie: the first player coming in the game). I join my partner via steam every time. When I come in, Jahan is no more linked to me (scarlett).