Did you clear out a significant number of the memory eaters? I'm not sure if that is required, since I killed a bunch before getting around to the third nest.