The gem may not be there since you have already killed Boratus, but his henchmen should still be around.

disappearing gem screenshot