Keep the scroll. Use it to get into the Doctor's basement: dump a bunch of fish in a barrel, along with a teleportation pyramid. Use the scroll on the barrel, then teleport to it and you'll be in his basement.