Not sure if I fixed it but I changed my PS4 audio settings from PCM to Dolby Digital and it hasn't messed up since. Still too early to tell if that works or not. Might be worth a try for anyone here who has the issue.