I found my load of holy water in act IV. Which I'm glad that it was so late, for balancing the game. I didn't use them until the final battle, it made beating the stuffing out of you know who very satisfying.