If you don't like the look of a shield and can use mods, there's one called "Parrying Weapons". Basically it gives you shields that look like daggers or even small staves.