Never really got the hang of that. My observation is that later in the game they get provoked if you are equipped with stolen goods regardless if it's theirs or not.
Anyways, if you port the entire party to a waypoint you will avoid all of this. Cheap and...cheesy.
