It will disappear if you leave it when changing acts. Everything is regenerated including all of the barrles and chests.