A couple people spread gems around their home base for ambient lighting at night.

I tended to hang on to gems, and use heavier loot first to trade with, when possible. Gems are light, so you can carry a lot of value without hurting your weight capacity. Gold is weightless, but since merchants have limited gold (except for one: New Money Trick found), I tried to sell off the largest, heaviest stuff first.