This whole dilemma happened to me too and I wish I had an undo button, but that dialog happens so early in the game you lose hundreds of hours just for one trigger.
Honestly I wish we could just get a second chance to offer to him, because like you said, the initial option is too ambiguous and didn't feel like a natural response.