Early in the game I didn't want to 'waste' any charms on equipment that could get replaced soon, so hung onto charms figuring I could use them if I ran into any problems. There were a couple times I used stat/armour potions before tough fights, but I didn't need more than a temporary bonus.
When I got to level 15, unlike earlier levels I didn't really have a good sense of where best to put the stat points, so just stuck them somewhere. Level 16 I was in the middle of a section of combat, so left them unassigned, level 17 I figured I should wait until my character started showing some weakness or vulnerability and then distribute stat points accordingly. By level 18/19 I was wondering how long I could go without using any more stat points... which turned out to be level 47 (ie the rest of the game).
Playing on nightmare and not using any stat points after level 15, it just seemed silly to start using charms.