I heard he doesn't count the time passed, but how often you talk to him. To be specific, someone got the scene because they tried to give him items he didn't want, which lead to a lot of opening/closing dialogue. Or they just waited too long. Who knows