There's a help box that comes up after you get the pyramids saying that they're now bound to your soul, and if you travel too far from them they will just reappear in your inventory. Not sure how too far is...