My experience too.
I found him before the board, so no killing. But after reading up on the quest I got an option to threatnen him and they all attacked.