As soon as I switched to an all-physical party, I ran into the guy with a permanent evasion aura in act 2 on Tactician difficulty. Then after I respecced to deal with them, all the other mobs got too difficult to deal with as a hybrid party, even after min-maxing.