INT with elemental is not that bad in Act 1 until you get to the witch.
But since you can't respec before the witch I'd still advise going either Finesse or ST.
(witch is totally beatable with magic tho, just don't use fire.)