Yes it works that way. The abjurer's ward is not temporary hit points, it is a shield of sorts. It simply grants a buffer of bonus hit points that get used up first, but that are not "temporary hit points"
Well if that is true, then Armour of Agathys almost certainly should not give damage, if attack is absorbed by that Ward. O_o
But it still seems more logical that they should not stack.