I've read in various places that the party will be set at the end of Act I. I would prefer at least one more permanent party member if that's the case. But regardless, not being able to take everyone along at will adds replay value, at least for me. I expect I'll run more than one character through and possibly play one or more of the origins. Each time, I'll pick my optimal party based on my own PC's strengths and weaknesses. If you only expect to play this game one time, then I can see why you'd feel limited by suddenly having access to all the options removed. I personally don't have a problem with it.