You are correct that the Exquisite Bottle of Wine is left in Anthrabert's room after his arrest. But, as I pointed out, using that Bottle to complete Corinna's quest still leaves an unfinished "Bottle of Wine" entry in the quest list.