It is by design that the teleporter stones are removed from your inventory as you enter act 4. The imp historian said he would be back for them, though there is no in-game cut scene or anything to explain that that was what happened.