You can get some holy water as a quest reward in act 2, after <span class='standouttext'>Spoiler : </span><span class='spoiler'>bringing the imp hermit the spider amulet from a nearby cave</span>. (highlight the text to read)