The poisoned by rat quest has nothing to do with what's behind those bars.
To put crystals in the bag, simply click on the bag, move the crystal bag window away from the inventory (so they don't overlap when you click on the inventory) and drag crystals into it. It can contain 5 crystals, and yes, you can remove them.