Can't you also simply not recruit him after the Curse is lifted in Act 2?