I currently put them all in a pouch carried by one character, that way I always have them but they are not cluttering anything up. When I come to a locked door requiring a key I already have in the pouch the "magic pocket" feature kicks in.
However I would prefer if they all just disappeared after they are used.
