You should reload a save before killing the bugs. I thought you had to talk to Swen to get the silver armour upgraded, but checking Kiya's site (link above, in the first reply in this topic), it seems it should happen as soon as the last bug dies. Whatever the glitch/problem was that prevented your upgrade, you'll need to revert to an earlier save to try again, and hope that it doesn't reoccur.