I'm relatively certain he's not talking to you with those ambient comments. He's talking to Kagha. He's not supposed to still be in your camp, for some reason he stays there after the party. If you go to the Druid temple, he's standing there saying those same lines to Kagha.
He definitely should stay in the camp! If you talk to him, you can ask him how he likes staying at the camp. It is just those bugged Kagha lines that need to go...
