Leya will remove all source collars without first freeing Gareth if you talk to her with Lohse and tell her a nice story. I forget the exact conversation choices required - something about boats passing on the ocean.
It has to be Lohse though - adding Jester and Mystic to a custom character doesn't give the conversation options you need.
