That said, the Sword Coast is extremely mixed in races, especially the cities, Humans of all colors migrate. So, sure, a majority of Humans, among the numerous races in the Sword Coast, may have lighter skin, though no one would care about it.
Tethyrians are the peoples that are described as the ones inhabiting the Sword Coast. They are described as dusky skinned, and only when you start going up north do they start getting lighter in skin tone. That means the majority of the humans in and around the Sword Coast should be brown, not white. Especially since Baldur's Gate is located on the southern part of the coast.
