I don't think it's a bug but more like how the spell have been coded.
From my understanding of how it work internally, Hunger of Hadar create a summon that apply "status effect". It's those status effect that deal damage. Since it's a summon, it don't use caster gear.