Actually you can store anything anywhere you want - even leave it lying on the ground - it will remain there.
Usually one sets up some sort of home base near a teleporter, and put some chest nearby for storing, and a stack of hay for easy resting (unless you decide to carry the weightless portable bed around)and a pyramid for quick access.
