That stat bonus expresses something about the world, not necessarily about my character. Exactly that is why the expectation exists and thus why that NPC can plausibly say such a thing.
I'm not saying it's super-important. But it does work that way.
I suppose I can understand that angle somewhat, yes.