The mods that are permanent are ones that make changes that are difficult or impossible to cleanly undo.
Permanent mods are only permanent in that specific playthrough, in saves made after they are enabled. They are off by default if you start a new game, or load an earlier save.
