I don't know about NPCs, but companions hate summonings by the the Warlock. Occasionally you see a small popup list of everyone getting a -5 attitude towards the caster (Wyll or the main character). Presumably if you did that near the NPCs in the grove, they'd have the same issue. Maybe not the Tieflings, they are part infernal themselves after all and spent time in Avernus so saw imps before. The druids would likely not like it much, though one could say they've been putting up with the Tieflings who they think are devils too.

I wish they'd fix the companions reaction though. Not liking it the first time, fine. But to keep hating on it makes playing a Warlock difficult to keep the companions' attitudes above neutral. Not to mention anyone at camp tends to be hostile if you come back with *any* summoned creature in tow.