I want arrows to be a manageable resource. However, having said that, in D&D 5e, if you are proficient with Woodcarver's Tools you can craft 5 arrows as part of a short rest (or 20 arrows as part of a long rest). Seeing as per short rest abilities refresh after every combat, I could see that after every combat, you automatically craft 5 arrows, while after every actual rest you automatically craft 20 arrows. This would make it much less of a resource that you would be forced to upkeep, while keeping true to the D&D 5e rules.