I don't think Sir Patrick is really that picky about who exactly stole the deed, especially after realizing the inadequacies of his home security. I did not give Finnigan his lockpicks back, and the portal stopped working for me also.