Put simply, Larian's insane power creep, homerules, magic items and potions laying everywhere is the main issue.

THERE ARE TOO MANY MAGIC ITEMS AND POTIONS TO FIND IN ACT 1 ALONE, let alone the rest of the game.

To put into perspective, going by tabletop rules. A party of characters between levels 1 to 4 is expected to received a grand total of 11 magic items. 9 Minor and 2 Major.

Minors are basically one-use potions, etc. And on that levels you get 6 common, 2 uncommon and 1 rare item.

Major are basically permament buffs like: weapon+1, but not armour +1. And certain other items.

So, a party between levels 1 and 4 can expect to find, for example:

-Bead of nourishment x4, feather token (basically potion of feather fall) and a mystery key (5% to open a door, then it disappears)
-Potion of Greater Healing and a Potion of Hill Giant Strength x1
-Scroll of a level 4 or 5 spell slot.
-Cloak of Elvenkind and a weapon +1

You get the idea.

In act 1 alone, we find dozens of magic items, laying basically. You can BUY THEM. This alone is pure idiocy. You don't go delving into dungeons, so that you can buy magic items from any merchant alone.

And that's the tip of the iceberg. How is game supposed to be hard, when you can stack the odds in your favour so damn much? Let alone with things such as broken Haste, etc.