Just checked, you still cannot say you don't want to do anything with Halsin after talking to Astarion (and you're forced to go to the date) or tell Astarion you were only curious about his opinion but had no intention of romancing Halsin.