That happened to me too. there's a random bug involved. Raze gave a work around - I think it was something like keep trying but, I'll research my question and get back to you.
EDIT: Here is a copy of Raze's answer:
or Sir Patrick, sometimes he is just stubborn, and going back to talk to the dwarven king and Grisha then back to Sir Patrick (multiple times) will get him to talk about it.
If not, there is a fix in a reply in the topic FIX for broken Imp Council Member quest.
He provided a link for the imp fix thing - a few topics down is my question - you can get the link there (if needed - I just tried again and it worked).
Last edited by caninelegion; 08/09/17 04:16 AM.