I have a similar problem. I talked to Wyll briefly on my way into the Druid Grove but he didn't seem interested in talking much and certainly not joining. Now I'm on my way out. There's a big diamond marker for him, but when I talk to him all I get is "Now, now. You'll have plenty of time to thank me later." And the conversation ends. Guess I'm off without Wylll.