Crouch. When you hover the mouse cursor over your target, it will let you pickpocket. A window will pop up to let you select which item (or gold) you want to try and steal.
Highly recommend going into turn based mode, otherwise they can turn around and find you much easier.
