We had this issue as well a few times. In Multi and Single Player with the same party.