If you agree to do a couple quest for the army, you can pick up whatever you want around the barracks (at least until you finish the quests).
There is an exploit for stealing, though it may make it easy enough not to be fun anymore. I think this also works for Pickpocketing, but the only time I tried picking someone's pocket was for a quest (where you have no chance of being caught anyway).
<span class='standouttext'>Spoiler : </span><span class='spoiler'>If you place a container in your inventory and open it, then drag and drop loot into the container it is not considered stealing, so you can simply walk away. It is considered stealing when you remove the items from the container, though, so make sure you are alone when you do so. If you have not joined the thieves' guild yet, the lowest weight container is a sack of grain.</span> (highlight the text to read)
