Option: get beast in your party. if you don't want to kick someone use mod that allows more than 4 characters.
I think malady will remove your collars.
But if your whole save is bugged....sorry maybe need to restart/ use old save