You can buy rings or amulets with a bonus to Pickpocket, but if you don't want to join the thieves' guild just skip the quests that required access (Corinna's summoning, holy items). If you have not joined the guild, how do you know there is no key there?
