You shouldn't need to re-install; just creating a new character should have been enough. Hopefully it will not get worse than an occasional glitch...
You can delete / move / zip old saves in Windows Explorer, if you wish (from the save/load windows you can delete saves one at a time by selecting them and hitting the trash can icon beside the save name text box.
Each save is a separate subfolder in the '..\Beyond Divinity\savegames' folder.
Under Vista/7, depending on how the user accounts are set up, if you install the game to the default Program Files path, Windows can create separate savegame folders for each user, and then map that folder to the game's savegame folder (so it will just see the saves for the relevant user).
C:\Users\ %account name% \AppData\Local\VirtualStore\Program Files\Larian Studios\Beyond Divinity\savegames
