That happened to me on my second visit to the hall of echoes. I didn't have the buff on my first visit yet.