I would be fine with adjusting advantage/disadvantage so long as they re-balance it, nothing is more tilting then not being able to hit the broadside of a barn just because you are on the same elevation as the opponent. I think High-ground should give some kind of advantage but the sheer difference between not having it and having it is the difference between being able to hit your target 8/10 times or 2/10 times and that makes it overly essential to game-play in the current build.
This especially sucks for surprise encounters because it either A. makes you use a spell slot to misty step to high ground right off the bat or B. since you know it's coming because you did it before re-arrange your party to where all range characters are already sitting on the high-ground to ambush the ambush.