Ok, I get it. I do have experience in this (this is me
https://www.linkedin.com/pub/jacob-marner/0/3b7/433)
What you are experiencing are not necessarily a problem. Do you experience frame rate drops when this occurs?
D:OS is clearly running multithreaded and that is good, but by default it is the OS that decides what threads go on what CPU.
Most game engines run most in the mean thread and then have various helper tasks running on worker threads (I guess this is the case on D:OS as well). So I see two ways this can happen:
1. It might just be that there is little work for the worker threads after a while. E.g. the engine can be doing caching for a while and when it is done the workers shut down.
2. It might be that something else happened on your computer causing a spike in CPU usage causing the OS to move the threads to your first CPU. And if that CPU is not the bottle neck they will not be moved back.