strangest thing, the first time I walked in, he was all "Get out!", but then I walked around for a bit, and I tried to get the key on his desk with telekenesis.
So I slowly stepped into his office trying to grab it, only to find out he didn't mind me walking around there! I just grabbed it and stole that dagger thing (have no idea what it's for, but I figured it's something good.)