Did you uncheck the "Weighted Dice" option in Gameplay menu ?
Because what that does is it controls the balance between wins and losses. So if you're succeeding in skill checks too much, it will then make you fail until it balances out. I don't know why it's turned on by default, but it's the first thing I turn off every update.
I can't imagine that rolling 5 2's in a row (doubt) is because of weighted dice. That seems like it would be the other way around
