Mini spoiler follows.
There is 1 way to reedeem your soul from the dark blemish of theft which stains you; this is what my character did at any rate. After joining the thieves guild, kill all of the thieves in their lair. The proof of the redemption of your soul will be the experience you gain. Ironically however your reputation will drop, and the townspeople will revile you though they will be afraid to attack. The guards will leave you alone. After you leave Stormfist Castle although your reputation again drops, the townspeople will cease their hostility. Now do you want to do that to pay for your life of sin and degradation or do you want to stay clean from the start?
Kiya, you are saying that the ends justify the means?
Cleglaw