Tactics, people, tactics... Hit and run if your character has a low acrobatics score, or attack from range. Watch your positioning.
As I said I had no issues in 1.0, but in EA, the only valid tactics was push/kill enemy before they push you - unless you hugged a wall for the entirety of the engagement which isn't fun.
Push being a bonus action means that an enemy can dash and push you in the same turn. In the past - in fact moving away from enemy used to make it more likely for them to push - I have been ranged characters dash from their elevated position only to push a fighter on the other side of the battlefield.
And yes, buffing everyones athletics does help to prevent it - maybe that's why I don't have issues in 1.0. I even chose entertainer background for my bard just to get proficiency in athletics, even though it wouldn't be my roleplaying choice. Maybe that's why I haven't seen many shoves - it's been my proprity no. 1 during character creation.
Still it is not a good implementation of the mechanic, though I can't claim it's been happening to me in my current playthrough. I can't say I have been enjoying the combat though. Rather than tightening the design, Larian's solution seemed to be to make the combat very easy.