You drop your pyramid somewhere in Rivellon and you can use it to go back in the cave where is the other one.
When you are in the cave, you take the pyramid in your inventory and click on "use pyramid" and not "on drop and use pyramid".
And you go back to the first one.

[Linked Image from squirrel.ovh]
duplouy.net badsquirrel.ovh
bad-squirrell.deviantart.com