That doesn't work because if the item leaves your inventory by dropping it, it leaves the hotbar as well.
However, the OP could get around this by picking up the pyramids after using them, or at the least, traveling to the shelter plane to recall them back into your inventory. (If he means he can't find them IN his inventory, he should try using the "Misc." tab.)
