Honestly I don't really care if they never give it any further combat uses, the fact that it can shove is plenty. What it really needs is exploring uses. It needs to be able to trigger traps from afar, or work levers, turn handles, etc. That's exactly what it's for. The fact it it can't operate the crane/platform controls in Grymforge, or the lava wheel during the Grym boss fight is ridiculous! That's EXACTLY what it's supposed to be used for. I can't express how frustrating it was to put my party on the moving platform, cast mage hand and have it not able to do anything for me.
Mage hand should ABSOLUTELY be able to trivialize some puzzles throughout the game.