I think damage is fine.
Happened to me that the first time I realized that pushing someone from high ground happened to my caster in the zhentarim lair....I was buffled that this was possible and started to do it too on my further games. And I think damage inflicted is fine, propably a little bit according to the rules at all, take only the vertikal distance and not the somewhat unrealistic ballistic curve into account.