I now use a party size adjustment mod, and it works. Pretty well.
But I wouldn’t want that on my first or second playthrough. There’s a lot of story that depends on the characters in your party. If you increase the party size, these plotlines get more dominant, overshadowing other parts.