Use/read the secret files directly in front of the mouth of the cave. Since you picked the mushrooms might take a few seconds but its within 10-15meters of the mouth of the cave.