Yes, you'll have to speak to an elder. But not that one, there's plenty of elders in act4...
Furthermore, I don't think you get to speak to your doll if you don't restore her, as it's the same ghost that normally sends you to get the 3 symbols to restore the doll that sends you off to act 4 then. (That's the ghost of the mother of your doll, btw).
Last paragraph I wouldn't know...
