As you explore Verdistis, you will encounter 3 gossiping women south of the park, who will mention a password you need to get into the brothel. After that, talk to Leptine in his shop just north east of Sir Patrick's house, and then return to the guys in the tavern.
