I was curious why Raphael was in the brothel if he wasn't romanceable. It doesn't even seem like customers were sleeping with him. It left me very confused as well.
Raphaël is spying on you constantly via Korilla. He must therefore know that Voss said he 'd wait for you in the Shares' caress taproom. So, if he wants to have a talk with you once you make it to Baldur's Gate, this would be a good place to wait.
Now this moves the question to, "why would Voss pick this place to meet you ?" Possibly because it's the only public place in town where the presence of a githyanki doesn't disturb people.
It is indeed part of the fun of the game to ask these kinds of questions and figure out an answer.
