I prefer 3 strong parties. But on Honour Mode I felt I had to add another body, too easy to die otherwise.
I don't swap Companions, but recruit those I want and kill or chase off the undesirables (yes, looking at you, Astarion).