This could *somewhat* be easily fixed with a simple checkbox for setting who your party spokesman is.

Crawling ahead with your 8 charisma trap-finder, deep in the underdark? No problem. Rather than forcing them to fail all your die checks your PARTY LEADER steps in and speaks...*sigh*