While I used the Talisman of the North for much of the game, I don't think lack of those 2 Wisdom bonus levels would have had a great impact.
The two teleporters you can access after getting the 4 parchments could have given you a skill book an bit of loot (nice, but not essential).
