Does she summon more redcaps if you've already killed the redcaps that were in sheep's clothing outside?
Nope. She tells you to enjoy playing with your new friends and then runs off. If you killed the redcaps they simply don't show up. As a side note I'd very much like to know how those ugly sobs manage to hit so hard and so reliably... XD