Your teleporter pyramids start working again (or they are returned to you if the imp historian 'borrowed' them when you enter the castle) after you rescue Zandalor (castle treasure room, sewer entrance), let him teleport you to the council hall and clear that area.
