Wow.... I'm in act 3 and I have like 200k worth of equipment and items. And haven't seen a single holy water.
By the way, you don't need to put the BF keys in your inventory. You just need to click on them while they are on the ground and the BF unlocks and stays unlocked. So you never need to pick them up.