You only have to restart the game to fix it temporarily, but it always comes back.