It's their intentions with the idol that's off the scales dangerous. They're in a temporary refuge, which is a powder keg between them and the druids, and went and got Arabella to try to steal the idol. They know how hard Kagha is. Heck, Mol even suggests doing it again! She's just a child and doesn't understand they'll set off a massacre that they themselves mightn't survive.

Sure, they've lost their child innocence, but they're much worse than the adults when making decisions about security and safety. Zevlor has all his best scouts out looking for paths and has managed to keep the peace. That communal cook is giving out bowls of gruel.

(Which reminds me, the druids all say there's not enough to go around but they all have food in their inventories, can cast goodberries, and most importantly, control access to river fishing.)

This all said, my proper playthrough Tav doesn't even engage them. As a noble, he sticks to Zevlor, Kagha, Nettie and Aradin. Tiefling children are Zevlor's charge.