The scroll is in a room to the far north on the second level of the imp castle, just west of where you defeated the dragon rider (map).