Correct. If it isn't worth it, don't put points in it. Perhaps the premise is so simple that it is missed?
How about this: If a stat or skill isn't worth it, under any circumstances, it should be removed from the game.
This is not a matter of Wits being bad for certain builds or underpowered compared to other stats. The first game had its fair share of borderline useless stats, but there was still some concievable reason you'd invest in them.
The only real reason you invest in Wits is for the init bonus. Now that bonus doesn't matter, and thus, it's an utterly useless stat.