The hobgoblin iron shadow in Volo's Guide is a female hobgoblin, but wearing a devil mask. They seem to look much like the males, but with more humanoid feminine features. Considering the same is true for goblins, I'd think the same would also be true for bugbears.
