Don't forget to let him unpact his melee weapon, if he has that.
It was only a while after he left my dark urge PT that I noticed his sword was missing from the bag with equipment he left.
It was the sword of justice, which he had pacted. Disappearing with the weapon makes sense actually, lorewise, but I didn''t think of it at the time. So I had to go back in time before he left, pact some other weapon to release the palladin sword and then let him leave.