Today I replaced my CPU and mainboard and the issue is gone. Looks like there is some issue with certain Intel processors or my old CPU (i5 6500) was simply not good enough.