I wouldn't revert that far back for just a skill book, two stat points (there are lots of such bonuses, so missing the odd one shouldn't be a problem) and a bit of experience from completing a couple quests. Just remember to hold off turning in the quest to find the bandit camp if you re-play sometime with a different character.
Skill Books/Stat Books/Dragon Skill Books Complete (spoilers)
