I just went through Stormfist Castle again (whee.) and remembered something I found out and utilized succesfully. I was a rebellious mage, so in an act of peaceful protest against being 'lord protector', I redecorated the entire fortress. Ever wanted that gold throne in your Verdistis home? Lamented over leaving so much equipment alone in the castle unless you became encumbered? All you have to do is take the items you want, sneak up towards the gate, and toss them a good distance from the guards! Then, when you eventually get kicked out, you have all the items you wanted to sell right in front of you- and no one will think you're stealing it! It even works for some of the merchants in Ars Magicana, but sometimes people will consider it stealing, so save before trying it.
(Just as a reminder though- don't pick the items up immediately after being kicked out. You have to deal with Elona's dungeon, and it's best not to go through that encumbered..)