Do either of you have this problem in single player?
Have you tried joining through Direct Connection, rather than Steam? The host can get their Server ID after loading a save in the Connection Menu (diamond icon top of mini-map), or you can try via IP address.
