Another idea for a situational dice set came to mind after posting the above: a butter-yellow set acquired by leaving the stones in every location where there is a contingency to reacquire them after you leave and lose the ability to return (that one realm where they're teleported back to your camp, the deep place where they wind up with some sahuagin or in a fish, and that building where some kobolds will spawn carrying them for you to get them back from are the ones I know of), all in the same playthrough. Butterfingers!