Tried it on a replay today, only lets me hit goblin Charlie, everyone else can't be hit.
It may just be random, then: it's happened with me a handful of times, I'd assumed that combat might've been the common factor. Perhaps not.
It's certainly happened more often when changing from a dragon into a human and finding myself struck (and frequently killed) by missiles and other nasties, though!