The little armor (I think, the left one) icon under portraits opens inventories too, even if not your selected character...