It is important that they be looking at the speaker at the precise moment when the speaker reestablishes eye contact: if they are not looking, the speaker assumes that they are disinterested and either will pause until eye contact is resumed or will terminate the conversation.