I started my first playthrough after patch 3. There were some performance issues and bugs but none so major that they prevented me from playing or enjoying the game.
I don't want to say your experience is wrong, but my experience is that it is specifically patch 4 that actually broke the game. This also seems to be what most others are reporting. I would be happy to go back to patch 3.
