I haven't figured out much yet tonight. Think I'm about to give up. It does appear that if I select the campaign before inviting players they download mods when joining the lobby but if I do it after then download the mods after I hit load game.

Not sure if this is a useful trick or just a tidbit of info.