It's not racism to understand that a 3 foot tall being that has the body of a child, is weaker than an 8 foot tall being from a species renewed for physical health.
If one yes ANY experience in martial arts, or contact sport, this is as obvious as the sun rising on a new day.
Sorry for the double post, but I wanted to point out that this can ALSO be solved with racial abilities.
Goliaths and Fir Bolgs have a racial that doubles their carry weight. This allows them to lift twice as much, carry twice as much, and throw twice as much as anyone else without just giving them a flat boost to hit chance and damage that a strength bonus would give.
It also allows them to get that sweet fantasy of being a huge being capable of effortlessly picking a grown man up with one hand for intimidation purposes or moving the large obstacle blocking the path.
Similarly the halfling has a racial that explicitly allows it to run between and under enemy legs if they are a size larger than them.
Abilities like these are a lot more fun than pure ASIs in my opinion.