I was able to get Oliver to respond by casting an offensive spell on him. Trying to talk to him didn't work, the mouse icon didn't show that I could interact with him, but I could attack him. Using physical attacks did nothing but the spell finally worked.
