I had the same problem on my first playthrough. If you kill the leaders before finding him in the pens, he will not be there when you first get there. You need to go back to the druid grove, he will be waiting there for you. At least he was for me.