Yeah, I'm using a controller and I wish I could remove:

The character portraits on the left
The character info on the bottom left (I already know who I have selected)
The minimap - It's too big.