Have the same Problem and at the moment i have to replay 4 hours of Act 3 and cant play Paladin because i dont have the patience to prevent the oathbreaking.
And to the why there is a Problem: You cant go back to Act 1 or Act 2 if you are far enough in the Game and the Oathbreaker NPC is not showing up in Act 2 and Act 3 in no of the Camplocations when you break your Oath a second time