Oh, yeah, as ExuroAether and Legotron2 hinted, I got the handy burglar from the Cyseal caves who used his winged feet ability to get to the offending switch. After that, everything was pretty straightforward.

J'aime le fromage.