Did you try talking to Leya with one of your alts?
The removing collar quest didn't trigger for me when i talked to Leya with my main, only with one of my alts - Sebille for me.