Why can't it happen while the homestead is under attack?

But that isn't it anyways, I had gotten a few stones before I even found him in northern LF.

Sounds like there are a few issues with scripts involving the portals and Z.