I've decided to break the pact because (if I remember correctly) Mizora said this will be an Eternal pact, not sure if it's same with the normal pacts and Wyll has been through a lot already, didn't want to take any chance. and I also expected there is another way to free the duke.