The opposite is true, though. If an associated character dies, he's still in your group so you have to resurrect him or go with three. I've had times when resurrection scrolls were tough to find where I would have liked to use a mercenary for a while until I could find one but had to stick to a party of three.