Once you get to the city, head north west, and take the stairs past the waypoint shrine and worker at the fish stand and follow the path north east, and when you get to the fountain head east a short way to the market. Before then there will be NPCs you can trade with, though not necessarily with a ton of stuff.
Keep exploring the city, and the imp will find you.