Seems to be linked to having freed Halsin first? I had done that before clearing the swamp. Having found and read (but been unable to take and had no journal update) the letter before returning to the Grove.
As a result there is no mention of the letter or shadow druids in the conversations with Halsin or Kagha despite my Tav knowing about it,