If you really want to be a villain (if you aren't doing this already) sell your arrows to the merchant and then steal them back! Rinse and repeat as needed! :p
Haha this works well. Unfortunately I think I have 2 vendors left in my game, one of them has great respect from me and I will never steal from them.