I always do this when talking. When listening I can focus on eye contact just fine, but my brain will not let me waste cycles trying to maintain eye contact while thinking through communication with someone.