I was wondering the same thing: if you step in that direction, Patriarch just resumes his conversation and then shoos you away.

J'aime le fromage.