I likely put to much thought in it but the magisters are rich so they have a lot of support of the common folk.
meaning if they are your enemy lot of people villagers would be your enemy see why it's wrong direction?.

a game without consequence do sounds bit boring at late game, likely they can fix this by adding factions and at least gives some sort of logic to the game.