Two people ran into this issue on PC, also with Jahan: one it was random, mostly when transferring items from Jahan to a particular main character (it was consistent when transferring directly from a container in Jahan's inventory), while the other could happen when transferring items to any party member.
In both cases, either saving and reloading or teleporting to a different map area would clear out the duplicate item icons in Jahan's inventory.
If just reloading does not help, try returning to the main menu before loading the latest save. If that doesn't help, try starting a new game, accept the random characters, then load the latest save. That would still be an annoying workaround, but less so than restarting the PS4.
Did you try teleporting to the homestead?