There definitely needs to be more warning *before* an oath-breaking action is taken (or inaction), because different paladins have different oaths, and it's not always easy as a player to be mindful of these things if you're jumping from one game (or even one save) to another. The goblin lair is the reason I'm abandoning my Palading playthrough, which I was otherwise enjoying. Playing an Oath of the Ancients paladin, and every time I try to help Halsin in his quest to stop the goblins, I wind up breaking my oath, and I can't figure out what's triggering it.
Conceptually, I enjoy the idea of classes being integrated into roleplay, but the execution needs better communication between the "Dungeon Master" (the game's systems) and the player. It needs to be able to ask the player "what is the intent of this action? Do you understand the ramifications?" and give the player a chance to change direction.
This is why I think if it is a Dialog based thing its probably just a matter of reading your options and deciding what you think is best considering your oath (this should change slightly based on said oath). However when it comes events where action or inaction may cause you to loose your oath it should maybe auto trigger turn based mode, (Maybe for paladins in specific a little blip that indicates you are in an encounter that has an effect on your oath, but maybe not idk). That said I also think it should take more than one incident or that the incidents should be weighted to determine if you become an oath breaker.
Example 1: You fail to save Smythin, it counts against you a little but not totally oath breaking. However do that a few more times and Oath breaker knight shows up and the dialog about you breaking your oath comes in to play, however you do not yet suffer the consequences of either having to be an oath breaker or suffer without some of your abilities just yet. You then have the opportunity to make better choices before the consequences catch up with you.
Example 2: You run into a merchant that you think might be evil, but rather than taking the time to confirm you just choose to slay him in cold blood. That might weigh heavier and be an automatic breaking of your Oath.