I mean, Tav following Karlach or Lae'Zel and abandoning him for 6 months is exactly "allowing them to leave him".
It looks really weird and out of character for AA. But oh, well. It's too late, I guess.