That may well be but its never actually provided as the reason of mistrust. Nor did the possible lack of food.
Both which are solved by enabling the refugees to do what they actually want to do - hit the road to Baldurs Gate. Which they cant do because of the Absolute forces. That druids hilariously just dont care about and apparently cant even think about.
And this is what ruins the narrative for me. There is a solution in sight that should not involve an outside agent like the player at all but the druids are so xenophobic that they refuse to look beyond the borders of their little grove and help the Tieflings leave. Zevlor even hilariously shouts out "we were just about to LEAVE!!!" when the Goblin assault you. Like, okay? Leave then? Last time I asked you you charged at me...