Shouldn't one blast of Fire Sphere take out a Memory Eater? If you just keep moving it shouldn't be hard to avoid their attacks, and a Fire Sphere cast every 5 or so seconds should clear them out faster than they can be replaced by the nests.
Try lowering the difficulty setting, if you are not already playing on easy.
Another..Hall of Echoes question
