It should be a tactical choice when to Shove your opponent instead of attacking them with a weapon.
It's silly that you get to freely push people as you wish in addition to doing full attacks.
And the distance needs to be toned down to 5' so you might have to push someone more than once to make them fall off a high cliff and take 10d6.