The linear devaluation by level is an odd problem. But it's because of their damage increase/level mechanic. The idea being, if you just leveled up and never put in any stat points. You'd do the same damage as you did at level one. Larian has confirmed that that was their intent. This makes it seem like you HAVE to invest every stat point.
They have already confirmed that they are looking into it.