I never rescued him. He appeared after I raided the grove and when I talk to him, we're somewhere else and he's in his cage, asking me to let him out. Conversation ends and we're back in camp.