So an update on me and my Gfs progress and how the game "fixed" It self. We finished act 2, And by the end of act 2 we noticed that it was improving. By the time we started Act 3 the issue was completely gone. What I did differently was go to settings and limit my quick save and Auto saves to 2 each. We havent encountered this bug eversince.