Gods I hate it too, maybe adding a scrolling panel on the right side showing the rest of the party members when at camp to keep clear who's in your active party while organizing inventory. Or giving us a "group recruit" option like in Dragon Age when leaving camp and a "dismiss all companions" to make it quicker. I hate having to run back and forth all over camp collecting and dismissing companions to figure out who has what and who needs to be upgraded with better gear.