I tried shooting an arrow to knock it down but it just broke. Thanks Oblivion for that little tip. I tried casting Mage Hand but no luck there, either.

I guess you need to get blood into the font? Need to be able to fill up all those useless empty bottles you find with blood from bloodied surfaces.