1. Blue Boar inn, on the table in the dwarf's room, refuse the gem and he will leave
2. on a table in the dwarven mayor's house
3. from the dwarven king, after completing a quest