It would be easier to just delete them from Windows explorer rather than in-game. Doing it that way, if you make a mistake you can restore them from the recycle bin.
You can change the number of auto and quick saves the game makes. I forget what the default is, I thought it was 30. I set mine to 10 each. I wonder if turning it down will automatically delete the extra ones.