In my experience, the one fight vs the Gith party was the hardest one, I was really really close to losing.
Anyway, I don't think that all fights need to be picked, we have to use common sense to understand if our party would be able to fight certain enemies.