The insta kill or high damage locations are so common it needs to be harder to pull off.
Distance needs to be shorter. Only inhumanly strong creatures (Str 20+) should be able to do the cartoony shoves. Strength needs to matter more. Gale has no business shoving minotaurs around with a negative Str modifier.
Enemies need to be smarter to avoid ledges.
And it needs to be an attack action.
Maybe there could be a reaction to step away from a ledge if someone is trying to push you down. If they fail, you can attempt to shove them on your turn. Put some risk in shove attempts so it's not such a no brainer move to attempt all the time.
