I'm afraid the problem is much more apparent in 5e. In pathfinder you can distribute points every level which makes the stat bonus not that important (these 5 points will not make a big difference in the end). However, it is different in the case of 5e where the increment is much smaller, which makes the ability score much more important.
The difference between a character who has +0 and +5 is huge.
I think that this problem will be indirectly solved when the stat rollover is available, so that you can set a decent amount of charisma without losing the character's power (14 should be enough, although personally I would prefer 16)