I experienced the same thing (not with Smythin, but similarly accidentally while sorting out the goblins), and it was frustrating at first, but when I spoke to the Oathbraker at camp, there were dialog options for it being unintentional, and a path to reclaim the oath, and I'm okay with that, it felt very natural.