I think you lose rep. because over all, Orcs and Imps are your enemies. but you are right, it is odd that you lose rep. by gathering the Council of Seven.