I noticed it too, I think it's a good idea to be able to switch inventories when bartering but since they already did this, it makes more sense to compare items based on who's inventory is being shown. I hope this is a bug and they fix it soon.