I have only restricted party members in my playthroughs so far: Solo, Duo or 4 characters.

Actually, on my last solo playthrough with a sorcerer, I decided she was scared of fire and so she never uses fire based spells.