I had this exact problem as well. Very annoying. Probably not much help but all I did was save my game, reboot my computer and reload and it stopped doing it. Also having completed the game this only happened to me in Act 2, I never had the issue anywhere else.
