I'm currently in act 3 and pretty much only left with the main quest. Overall I can say that I liked act 1 the most ... by far. I feel the same as you with act 3, though I didn't have any trouble with the encounters so far. My companions don't have much to say anymore as well. Doesn't feel as immersive as it did in the beginning.
