Its not Dual WIelding problem that you see Shove as perfect answer for anything, that is in your own head ...
Game gives you options ... its up to you wich one and how you will use. :P
(See? Again coment on topic ... try it somethimes. :P )
In most cases it is the superior choice. Having options doesn't mean much if those options aren't well balanced. There are some encounters in which shove won't be as useful, but in any encounter where there is high terrain and/or insta-death pit shoving just offers a better payout then offhand attack.