Do you have a save with, or just before, the second time being arrested? I don't think anything is suppose to be removed as part of the arrest mechanic.
I also experienced this way back: I assumed it was a deliberate design choice and learnt not to get arrested twice! Sadly, the save is long gone (well, and incompatible anyway).
