I noticed them disappearing at some point between the beach and reaching the grove (not sure exactly when, it was a long session). Then after completing Chateau Gobbo and teleporting to the grove to talk to all the tieflings again, they were back.

Nobody's perfect... I'm a nobody.