Yeah... And I wanted to risk going to jail instead of save scumming while pickpocketing and that inventory thing made me rethink that. Instead of RP I'll have to save scum and not go to jail - which is essentially cheating.
Another annoying thing is that wares lose their tag, so you have to tag them again.

Inventory should be snapshot when you go to jail and fully recovered as they were when you interact with the chest.