I should also add that I(the host) and the other person we have narrowed it down to, have no Mods installed.

We can also start solo games in Definitive Edition without any issues.