Hmm, from an explanation in-game I understood that the pyramids are bound to you, so you can never lose them. Apparently you can.

A long shot, but have you checked Zixzax to see if he has a new subject to talk about? (Like: Pretty please return my lost Pyramid, Zixzax.)