End the conversation manually, before it gets to the end of his dialogue. There is a short cutscene triggered after the conversation with him, which a few people have had a problem with. Ending the dialogue early should avoid that.