I think trivializing the ability points is the wrong direction. I think the idea is rather to make the ability points feel more prominent and important. A slight increase the effectiveness of a single point at the cost of reducing how many points you get would accomplish a lot more toward getting them where I'd like to see them.