I'm not sure you're arguing the same thing. Building tall is not equal to building wide. Party size is about combat encounters and dialogue bandwidth, and doesn't really have anything to do with the quality of either except as a matter of preference.
