Apparently if you play as a halfling, they will automatically re-roll any 1s because they have the Lucky feat. Pretty sure that’s the case. Any character can get the Lucky feat as well, although I personally wouldn’t spend a feat on it. So you might want to try playing a halfling if it really bothers you. I like what Larian did to compensate for this (the 1s getting rolled), which is allowing for re-rolls based on the inspiration points that you have.