You don't have to replace the entire profile, just the UILayout.lsb file in your profile folder; rename or delete it and the game will recreate it the next time it is started.
..\Documents\Larian Studios\Divinity Original Sin\PlayerProfiles\<ProfileName>\UILayout.lsb
You can just move the saves from the renamed profile into a new profile's savegames folder. Warning: Do not try re-creating a new profile with the same name as the renamed folder, or it will be overwritten (that will hopefully be fixed eventually).