You won´t get happy with this way avoiding most fights cause you need not only the XP, but the loot! Especially the fights vs the magisters in the fort gives you some really nice equipment. Without that I wouldn´t dare the last fight of this chapter....
