Yes. Characters from different backgrounds or areas are going to sound different.

Like would a Baldurian half-elf who grew up in the city sound different from one who grew up in the woods?

Too many variables I think. Some might complain the voice doesn't fit their character.