I'd forgotten about that nagging voice!
I also remembered finding a potential means of getting into the greater part of Broken Valley without reaching the correct quest point, but I imagine that would probably break things horribly so I never actually did it ahead of time. Er, randomly, etc...