There is a low chance of buying holy water, but it should be available in any of the acts AFAIK. Maybe you were just lucky seeing it that often in act 2, and the law of averages is catching up to you?

Item / equipment drops are influenced by the average character luck, but the chance of finding holy water in the BF is not. One of the Larians said that only your own luck is involved.