If you go through the speech options, he should give the teleporter stones back to you (they get placed directly into your inventory). You say 'hey, you're the imp that stole my teleporter stones', and he apologizes and explains he needed them to get into the council hall, but then got trapped.