Well, there is a forced +1 to all stats, so minimum is 2. Unless of course sacrified then once again in Bellegar's cave.
EDIT: Not to mention, not use the Potion of Wisdom. As you found out you can't take it afterwards again.
It might be more useful if you're starting a new game on FoV.
