Had the same issue with gobbos in the temple. Only one character was hostile to the gobbos after the initial attack, others couldn't even trigger hostility by attacking.