I have this "issue" as well. There is just sooo much. I just started act 2 after 65 hours lol.
Gotta train yourself to get into the mindset to not rly min/max atm. Downsides make it not worth it imo. Its hard to find balance here.
Looking up so much info made this harder as well.
I will get bette at this from now on..i think.
GL HF

Btw: i respecced from bard to ranger. Made things a lot clearer and easier. And while i really liked bard, i am loving the ranger more.