If they do, what sense does it make
That they can just "take your gear" without you allowing it
It's called "stealing", more or less...;) Yes, we'd all much prefer thieves to ask nicely before robbing us, and then to desist if we find it inconvenient, but thieves aren't known for their manners...;)
Although I never sat down with them, I dealt with them once by daring them to make me empty my pockets--at which time they left me alone--and then in an earlier game I refused to empty my pockets and they didn't like that so we fought and I ended them--permanently...;) So, there are a couple of ways to get through them without getting robbed.
"Lie down with dogs and get up with fleas, lie down with thieves and your purse may be relieved," etc.