Just figured it out. I was putting the gems on the idol itself, not the box.
boy do I feel stupid. <img src="/ubbthreads/images/graemlins/ohh.gif" alt="" />