You get a chest once you acquire the battle tower (I think 10 or 20 hours in); until then there is a skill to increase your carrying capacity. I don't have the game yet, so am not sure what the best thing to get rig of first is (I don't think you need to keep most books, and once you have the tower you can send servants to fetch plants, etc).