Not taking her along must feel like a betrayal.
I don't take her because the dialogue only consists of two options: kill her or let her do whatever she wants. To me, that's a mockery of the party leader role by the dialogue writer. That's not how hierarchy works - you either stay in the group under the leader's command, or you leave. There's nothing in between. That's why I prefer not to take her in the Nightsong jail rather than kill her there.
There should be a third option - reasoning with her. Throughout the game, she's portrayed as a compassionate person, so why would she support all the rot and decay we've encountered during our journey? She says Shar represents darkness and protection, but the game clearly depicts Shar as a force of death and destruction. So why not an option to reason with her based on what the party experienced in the cursed lands?