I have the exact same issue too, it is very disturbing. I have an Asus Xonar D2 if that matters.