For me it felt like the masked fighters in the hags lair couldn't stop themselves from pushing me off any high ground. Enemies can absolutely push you, but they mainly do it when fall damage is guaranteed.