You should have the option to say something like 'You've traveled a lot. Have you ever seen anything like this?' if you have one of the treasure maps. I cleared Rivertown (and got the spider cave map) before going to Verdistis, and IIRC he had that option the first time I talked to him, after his cart burned.
