Did you mind read him, think you need to do that to get the teleporter to be changeable.
You then change the destination and let him out and he goes to high hall.
After that one use if you follow him or leave the area I think it goes back to being locked to only going back down to the harbor (slayer) area, no more high hall option.
