Canon doesn't explain these things, so yeah, it's my headcanon, but since there is no canonical official explanation to all this, then my headcanon is just as valid as yours. Maybe Tav warned other party members that if they see them with AA again, this means AA enslaved them. Perfectly reasonable explanation. Maybe Minsc, Jaheira, Wyll, who stayed in Baldur's Gate, were looking out for Tav, because they were warned by Tav to defend them against AA.
I didn't say he wasn't willing to do it. I said there's a circumstance *in which he doesn't* which is literally in game.
So? It's like to say: "See? Sometimes this killer doesn't kill people!"