As I replied earlier to your support email, someone on PC ran into this issue some time ago, and drag and dropping the other portraits to link / unlink / rearrange could randomly get portraits to reappear, as well as disappear.
Does saving and reloading restore the portraits, at least until you try linking or unlinking again?
