Now this moves the question to, "why would Voss pick this place to meet you ?" Possibly because it's the only public place in town where the presence of a githyanki doesn't disturb people.
That one gets answered in game by a letter you can pickpocket from Voss. He has an appointment with Raphael who invited him to meet at Sharess' Caress.
Interesting, so that invalidates my theory above that Raph spyed on you and went to the Caress after learning that Voss would be there.
So Raph chose "the caress" for Voss. Could still be because it is the place where all races can mingle withoutthe locals raising eyebrows. We don't see any Githyanki in the lower city.
