I think fingers are just some rando choice, from the magic school of a hair or something from a body activates a voodoo doll. It's the goofiest of connections, but hey, magic!
I remember reading 2e's Girdles of Giant Strength were made of the muscles off the respective giant's back. A pretty career-ending injury! In so far, only losing a finger is maybe progress?
