For anyone who is in the same situation, it seems like the only way to prevent attaining the permanent curse is to use The Swornbreaker's ability right before fighting Isbeil.

Tested it and the dialogue with the God King did not trigger after the fight, compared to my previous attempt of using The Swornbreaker after the fight (and before talking to the God King the 2nd time).