He doesn't have a brother. But he does have a sister. She is named Arka.
My point was it doesn't matter. Arka can sell the clothing, or it could be Jamie Lannister. There's not a lot of narrative legwork needed to justify why a clothing vendor is in the grove.