Actually i'm pretty sure I did kill the crocs without taking the quest once, and one of them still dropped the gloves, but i've only done this once so there might be a way to not get them
as you said I'm just not sure it's related to not taking the quest.
