It happened to me just once with Laz'Something... Well, the green lady.
I though it was because my action across the game up to that point were at odds with her morals, but then I reloaded the game and that never happened again... Which sounds like a bug to me.
