You can right click on container windows (the cosmetic parts) and the inventory window (anywhere outside the inventory slots or over text) to close them.