Did you really speak to him about everything? Ask him about his retirement plan or whatever? I don't remember there being a charisma check or anything to get him to give you the quest.