Another addition to this suggestion would be the ability to challenge NPC's to minigames depending on the NPC.
For instance:
Mercenaries / Rogues = Duel.
Soldiers / Guards = Some kind of card game
Merchants / Travelling bards = A game of wits