You can drag and drop the keys into your inventory, though as you said, don't need to.