It's not realistic, but it's pretty down the line of things that bother me, frankly.
I wouldn't be AGAINST "fixing" this, but I can't really say I care much about it either.
Given what a mess the inventory management already is currently, the less the game gives me reasons to spend even more time browsing my bags and moving things from one place to another, the better.
And frankly I can hardly remember more than one or two circumstances where I actually found myself taking advantage of this.