OK, after throwing the second switch, in that same area, I clicked on something to the far west (hole in the floor?) and was apparently in a lower level. However, I didn't want there yet so went up the ladder. Seems like that was a one time good deal as I can't find a way back. Weird glitch or a random additional area?