Your reputation is how the average human sees you. While some more enlightened individuals may agree that gathering the council is good and necessary, the average person does not know much (if anything) about your motives, and just sees you consorting with the 'enemy'.