You can also keep Bairdotr with you, and attack Jareth before getting close enough to trigger the conversation.