One small thing to keep in mind is that the high ground is largely a buff to ranged characters, who have had their range nerfed rather badly in BG3. Taking that buff away without compensation would likely make them rather sub-par and overall liabilities in a party.
