If I do recall correctly, there is more than a room up there. One leads you to the skeleton enchanter whose name fails me now, and the other room leads you to the place you're looking for. The key should open both doors.