My party is level 10, and I'm still not even sure how to unlock the teller of secrets. So far as I know, I've done everything through (save for returning the staff to the mayor, so maybe that's the clincher).