That said... You can steal a container, such as a locked chest and then it stops being considered "Stolen" for any actions involving it later.
You can, for example, steal Kagha's chest... Then drop it in front of her and pick the lock and take stuff out of it and no-one will care.
Oh cool, I did not know this one!
