Yes you can leave items anywhere, take over abandoned houses, re-arange the furniture, collect chests to keep things organized, and everything will stay where you leave it.
Merchants later in the game will have more money, so keep the high quality stuff you do not want, to sell later.
Early Starter Tips (NON-Spoiler Version) 
