I seem to have been revoked of my Hall of Heroes privileges.

I had the stone from the murder scene and the one from Evelyn for healing one of the guys. I explored the hall of heroes, talked to the ghost lady and the guy who would let you hire companions and decided to keep the party the way it was. A bit later I went back to try one of the other companions but the portal was closed and I had no access.

Is this supposed to happen? How am I supposed to get back in?