There is a note on the floor in that area. If you read it the adventurer who wrote it said he knows what to do... he will put both red or yellow gems in the idol. Now notice that he is dead... that is a big clue.