is it truly harming you gaming experience? it's a button that you press.. Single player is purely single player no option of adding in a friend.

Multiplayer while you can choose to set it for no one to join at the start..can be changed so someone can join later.