Don't allow itemswapping between characters in combat with characters not in combat?
Of course, you can still go back and then trade, but it's far less convinient and more timeconsuming and all.

Not to mention I haven't found potions or scrolls ever useful so far :p