There are many skills, whose damage does not depend of a weapon, even for non-magic skills, so the same could work for Polyporph. Bull Rush makes you ram enemies with your head, and not your weapon. So only a headwear would make sense to influence damage. xD