I specifically hoarded skill points because of complaints there were too few, and had no problem at all. While some skills were more divided than they needed to be, having subgroups for skills allows much more customization, and tailoring to specific builds.
I haven't tried it but, with the skill points having so little affect, not using them at all and just building up attributes would likely lead to not having any trouble at all.
