For the sake of game balance, and to preserve a mild benefit for seeking higher ground (that is in line with 5E rules) – I would suggest removing the advantage to hit for the high ground attacker and instead give them a +2 to AC vs attacks from below.
