Not completely sure, but 12 seems to be the cutoff-point for all other stuff (wearing armor, spells without penalty). I know you need 11 perception for some of the Hunter's Edge stuff.