I hardly ever craft gear, I use whatever weapons, armor etc I loot or (occasionally) buy from vendors. But I did start crafting useful stuff like potions, etc pretty much from the start.
I guess it'd be up to you, your play style and your needs at the moment. But read all the recipe books you can, and maybe hoard crafting material.