The HP bloat is an issue now, and it will be later too.

I want to feel like I can one-shot goblins at level 4 with a good Eldritch Blast.

Larian may also decide to put goblins in further down the line, and I do not want them scaled up hardcore.
What's the point of having a caster learn abilities like Fireball if you can't use it to cut out all the fodder in an epic explosion?

I can see it now. A horde of goblins when your characters are level 5/6/7, and they're all the same level as you for reasons.
Gale throws a Fireball, just making a giant floor covered in fire, not killing a single goblin.
Then he gets focused and dies immediately.

That's not the game I want to be playing.