My friend and I have been testing some interesting interactions regarding this Patch2.pak Bug.
First, we opted to just clean our mod folders and re-download our mods as a sort of clean save. At first you can join cleanly but as you play the game and then come back and try to rejoin as a player you have to download Patch2.pak.
Second, we opted to delete Patch2.pak on the hosts end from the defEd data folder. This caused the game to download Patch1_TDE.pak to the non-hosts . We then opted for the host to delete that file and then the game decided to download Patch1_Hotfix4.pak to the non-hosts documents mod folder. We then did the same for Patch1_Hotfix4.pak and the game started downloading Patch1_Hotfix2.pak to the non-hosts documents defed mod folder.
Third step was to try with no mods and it the game did NOT download anything to the non-hosts mod folder.
Fourth we decided to try specific mods to see if it is a mod issue. We found Armor Based Saving Throws, Crafting Overhaul, and Astroyka's Traders to cause non-hosts to download Patch2.pak as of 12/30/2018.
I have no idea whether this is a modder issue or Larian issue but i wanted to help by reporting our findings in hopes someone can figure out why.
As soon as these mods were disabled all of our Patch2.pak problems were gone.