The hotbar was really annoying. It's much more usable without the auto-add feature; okay, I often forget stuff I've picked up and could use, but on balance that's much less bad than not having the stuff I want to use arranged as I like it.
The bags are annoying. The tiny 5×4 window, the tendency to auto-scroll back to the top, the jumbling of stuff into a completely random disarray for anything not in your inventory, the dragging (did I get hold of it?) and dropping (will it just catapult itself back to where it came from for no reason?), will it or won't it stack? and so on are driving me nuts.
I'm also not big on the icons-with-text-but-only-if-you-hover thing: I mean that goes back way further than the Morrowind vs. Oblivion icons-vs-text inventory system. In the end I preferred the DarNified Oblivion scheme that had icons and text but nicely arranged and big enough to be readable but small enough to fit a lot of stuff on the screen.
Hopefully the UI will see a lot more attention and have options, or will at least be amenable to modding this time.