I didn't encounter this problem, but I found Oliver before getting the Moonlantern, so I'm not sure if that had anything to do with it.