You are 100% correct the 2 points mean nothing in the long run... So then what is the problem?
Ohh right because psychologically we try to optimize our play strategies. To NOT use the strength of the dwarves is to intentionally play badly even if it is rather minor.