Just figured out the problem, after the new patch, even if you do disable the mod: "Party Size Evolved"
All players must have this file in the appropriate location to load in as normal.
https://steamcommunity.com/sharedfiles/filedetails/?id=1147333888
Once all the players downloaded and moved the file to the proper location, everyone loaded in under 30 seconds.
Before we had it setup where the host was the only one that had the file.
