That's why I choose to set up camp at the entrance of the Homestead. This way I always have a dedicated teleport to my base where my chests are. Of course this still means I have to walk back to where I was on the map from a waypoint when I teleport back but I don't mind.
