Yeah, maybe - I just killed him while he was in my party. The "quest" & warning dialogue started. Then I just long-rested 3 times.