You just don't remember the pass streaks compared to the fail streaks because we always tend to remember the bad instances.
Trust me, I remember both good and bad rolls. Because I try to play with different classes and alternately play either a warrior with 12 Charisma, or a rogue with 16 charisma. And it is much more difficult to get the necessary results in dialogues with rogue.
It's just dissapointing that i spent several skill points in vain and spent several hours playing rogue to understand that +2 persuasion or +5 persuation have no difference.