Now discussing what stats to dump even if rolled stats realistically there are some stats to dump. I would say classically INT is biggest dumb stat unless you are say Wizard when it is one of the most  important stats.
In DND 5.0 (not so earlier Dungeons Dragons rules example DND 3.5 and I guess Pathfinder) the INT stats does not affect how many skill points you get.
There one big issue. The plot is strongly influenced by illithids whose attacks target INT saves, also the arcana skill checks will be pretty common.
