We just hit one over the fence, it worked.
I have both Speed Mod and Permanent skill books mod working together by moving your single Root table file over into the Speed Mod's root table folder, which I have that mod associated with my current game.
I cannot trade the spell book to another character, it moves but disappears, which I actually like as it would have been a little too much cheese. But it totally fixes the idea of unlearning and relearning spells on any level for each player. This was actually a beta issue I had, now erased, like the speed one.
So am I thinking right, that perhaps we should make a Blank Base Mod and check that when we start a game and then we can add mods to that as we go without having to restart?
Anyways, it has begun. Mod count 2 on my game!

EDIT: Of course as you say over time putting too much in one can have other undesired affects, but even in Skyrim that could happen. We'll see, I'm still happy about this little feat.