I use the game bar fairly regularly ro record some fragments, but I haven't seen this happen.
The times that I switch to the desktop are when another background program (usually my backup) throws a popup screen, or when I inadvertently push the <windows> key instead of the <alt> key just beside it.
