Now this moves the question to, "why would Voss pick this place to meet you ?" Possibly because it's the only public place in town where the presence of a githyanki doesn't disturb people.
That one gets answered in game by a letter you can pickpocket from Voss. He has an appointment with Raphael who invited him to meet at Sharess' Caress.
