The gaze cueing effect is characterized by faster attentional orienting to a gazed-at than a non-gazed-at target. This effect is often enhanced when the gazing face bears an emotional expression, though this finding is modulated by a number of factors. Here, we tested whether the type of task performed might be one such modulating factor. Target localization and target discrimination tasks are the two most commonly used gaze cueing tasks, and they arguably differ in cognitive resources, (...) which could impact how emotional expression and gaze cues are integrated to orient attention. In a within-subjects design, participants performed both target localization and discrimination gaze cueing tasks with neutral, happy, and fearful faces. The gaze cueing effect for neutral faces was greatly reduced in the discrimination task relative to the localization task, and the emotional enhancement of the gaze cueing effect was only present in the localization task and only when this task was performed first. These results suggest that cognitive resources are needed for gaze cueing and for the integration of emotional expressions and gaze cues. We propose that a shift toward local processing may be the mechanism by which the discrimination task interferes with the emotional modulation of gaze cueing. The results support the idea that gaze cueing can be greatly modulated by top-down influences and cognitive resources and thus taps into endogenous attention. Results are discussed within the context of the recently proposed EyeTune model of social attention. (shrink)

ABSTRACTAnother individual’s gaze automatically shifts an observer’s attention to a location. This reflexive response occurs even when the gaze is presented subliminally over a short period. Another’s gaze also increases the preference level for items in the gaze direction; however, it was previously unclear if this effect occurs when the gaze is presented subliminally. This study showed that the preference levels for nonsense figures looked at by a subliminal gaze were significantly greater than those (...) for items that were subliminally looked away from. Targets that were looked at by a subliminal gaze were detected faster ; however, the participants were unable to detect the gaze direction. These results indicate that another individual’s gaze automatically increases the preference levels for items in the gaze direction without conscious awareness. (shrink)

Gaze cueing effect (GCE) refers to attention orienting towards the gazed-at location, characterised by faster responses to gazed-at than non-gazed-at stimuli. A previous study investigated the effects of affective priming on GCE and reported that threatening primes enhanced GCE. However, it remains unknown whether the threat or heightened arousal potentiated GCE. We investigated how highly arousing threatening and positive primes, compared to low arousing neutral primes modulate GCE. After a brief exposure to an affective prime (pictures of threat (...) or erotica) or a neutral prime, participants detected an asterisk validly or invalidly cued by the gaze direction of a neutral face. The results showed that the threatening primes diminished the magnitude of GCE. The highly arousing positive primes did not have an effect on GCE. Further analyses showed that, as compared to neutral priming, the reaction times after threatening primes were shortened on invalid trials. This finding was interpreted to suggest that the threatening primes enhanced goal-directed target detection and attenuated attention orienting by irrelevant gaze cues via improving executive control. In sum, the present findings indicate that threat priming modulates GCE, not because of heightened arousal but because of the threat. (shrink)

Referential gaze has been shown to benefit language processing in situated communication in terms of shifting visual attention and leading to shorter reaction times on subsequent tasks. The present study simultaneously assessed both visual attention and, importantly, the immediate cognitive load induced at different stages of sentence processing. We aimed to examine the dynamics of combining visual and linguistic information in creating anticipation for a specific object and the effect this has on language processing. We report evidence from three (...) visual‐world eye‐tracking experiments, showing that referential gaze leads to a shift in visual attention toward the cued object, which consequently lowers the effort required for processing the linguistic reference. Importantly, perceiving and following the gaze cue did not prove costly in terms of cognitive effort, unless the cued object did not fit the verb selectional preferences. (shrink)

The auditory gaze cueing effect (auditory-GCE) is a faster response to auditory targets at an eye-gaze cue location than at a non-cue location. Previous research has found that auditory-GCE can be influenced by the integration of both gaze direction and emotion conveyed through facial expressions. However, it is unclear whether the emotional information of auditory targets can be cross-modally integrated with gaze direction to affect auditory-GCE. Here, we set neutral faces with different gaze directions (...) as cues and three emotional sounds (fearful, happy, and neutral) as targets to investigate how the emotion of sound target modulates the auditory-GCE. Moreover, we conducted a controlled experiment using arrow cues. The results show that the emotional content of sound targets influences the auditory-GCE but only for those induced by facial cues. Specifically, fearful sounds elicit a significantly larger auditory-GCE compared to happy and neutral sounds, indicating that the emotional content of auditory targets plays a modulating role in the auditory-GCE. Furthermore, this modulation appears to occur only at a higher level of social meaning, involving the integration of emotional information from a sound with social gaze direction, rather than at a lower level, which involves the integration of direction and auditory emotion. (shrink)

ABSTRACTHumans are social beings that often interact in multi-individual environments. As such, we are frequently confronted with nonverbal social signals, including eye-gaze direction, from multiple individuals. Yet, the factors that allow for the prioritisation of certain gaze cues over others are poorly understood. Using a modified conflicting gaze paradigm, we tested the hypothesis that fearful gaze would be favoured amongst competing gaze cues. We further hypothesised that this effect is related to the increased sclera exposure, (...) which is characteristic of fearful expressions. Across three experiments, we found that fearful, but not happy, gaze guides observers’ attention over competing non-emotional gaze. The guidance of attention by fearful gaze appears to be linked to increased sclera exposure. However, differences in sclera exposure do not prioritise competing gazes of other types. Thus, fearful gaze guides attention among competing cues and this effect is facilitated by increased sclera exposure... (shrink)

ABSTRACTWe examined the utility of a gaze cueing paradigm to examine sensitivity to differences among negatively valenced expressions. Participants judged target stimuli, the lo...

The present study employed the gaze-contingent window paradigm to investigate parafoveal and peripheral cueing and masking effects on saccadic selectivity in a triple-conjunction visual search task. In the cueing conditions, the information shown outside the gaze-contingent window was restricted to the feature or feature pair shared between the target and a particular distractor type. In the masking conditions, no stimulus features were shown outside the window. Significant cueing and masking effects on saccadic selectivity were observed (...) for saccades directed at items within the window, where all features were visible across experimental conditions. Cueing a particular feature or feature pair biased saccadic selectivity towards this feature or feature pair, while masking generally reduced saccadic selectivity. These findings support the concept of visual guidance being a preattentive process that operates in parallel across the display. © 2001 Published by Elsevier Science Ltd. (shrink)

Although the majority of literature has shown undistinguishable attentional effects when eye-gaze and arrows are used as cues, recent research has found that whereas eye-gaze selectively orient attention to the specific location or part of the object looked at, arrows unselectively direct attention towards parts of the environment. However, it is unclear whether this dissociation between gaze and arrow cues is related to social cognitive mechanisms such as the attribution of mental states (Theory of Mind, ToM). We (...) aimed at replicating the dissociation between gaze and arrow cues and investigating sex differences in attentional object selection triggered by these two types of stimuli. While we replicated the arrow-gaze dissociation, this was equivalent in the male and female population. This finding seems to run counter the intuition that theory of mind abilities can account for the dissociation observed between gaze and arrow cues since greater ToM abilities have been generally shown in females. However, this conclusion it must be interpreted with caution since no differences in ToM abilities and autistic quotient scores were observed between male and female in our sample. Further research is needed to shed light on this issue. (shrink)

In everyday interactions, humans naturally exhibit behavioral cues, such as gaze and head movements, that signal their intentions while interpreting the behavioral cues of others to predict their intentions. Such intention prediction enables each partner to adapt their behaviors to the intent of others, serving a critical role in joint action where parties work together to achieve a common goal. Among behavioral cues, eye gaze is particularly important in understanding a person's attention and intention. In this work, we (...) seek to quantify how gaze patterns may indicate a person's intention. Our investigation was contextualized in a dyadic sandwich-making scenario in which a “worker” prepared a sandwich by adding ingredients requested by a “customer.” In this context, we investigated the extent to which the customers' gaze cues serve as predictors of which ingredients they intend to request. Predictive features were derived to represent characteristics of the customers' gaze patterns. We developed a support vector machine-based (SVM-based) model that achieved 76% accuracy in predicting the customers' intended requests based solely on gaze features. Moreover, the predictor made correct predictions approximately 1.8 s before the spoken request from the customer. We further analyzed several episodes of interactions from our data to develop a deeper understanding of the scenarios where our predictor succeeded and failed in making correct predictions. These analyses revealed additional gaze patterns that may be leveraged to improve intention prediction. This work highlights gaze cues as a significant resource for understanding human intentions and informs the design of real-time recognizers of user intention for intelligent systems, such as assistive robots and ubiquitous devices, that may enable more complex capabilities and improved user experience. (shrink)

When humans are addressing multiple robots with informative speech acts, their cognitive resources are shared between all the participating robot agents. For each moment, the user’s behavior is not only determined by the actions of the robot that they are directly gazing at, but also shaped by the behaviors from all the other robots in the shared environment. We define cooperative behavior as the action performed by the robots that are not capturing the user’s direct attention. In this paper, we (...) are interested in how the human participants adjust and coordinate their own behavioral cues when the robot agents are performing different cooperative gaze behaviors. A novel gaze-contingent platform was designed and implemented. The robots’ behaviors were triggered by the participant’s attentional shifts in real time. Results showed that the human participants were highly sensitive when the robot agents were performing different cooperative gazing behaviors. Keywords: human-robot interaction; multi-robot interaction; multiparty interaction; eye gaze cue; embodied conversational agent. (shrink)

The last two decades have witnessed growing interest in the study of social cognition and its multiple facets, including trust. Interpersonal trust is generally understood as the belief that others are not likely to harm you. When meeting strangers, judgments of trustworthiness are mostly based on fast evaluation of facial appearance, unless information about past behavior is available. In the past decade studies have tried to understand the complex relationship between trust and joint visual attention (i.e. attentional orienting following another (...) person’s gaze). This review will focus on the studies that used a gaze-cueing paradigm to explore this relationship. One study found enhanced gaze-following behavior with trustworthy faces; another one found stronger effects of gaze-following with faces associated with undesirable behavior. Notably, the majority of studies failed to observe significant interactions between trust and gaze-following. Overall, the evidence is mixed, and studies have highlighted the complexity of this relationship. Multiple factors seem to play a role, including the type of manipulation to induce trust, the level of trait-anxiety, and gender. We conclude that further investigation is needed to clarify whether an interaction exists between trust and joint visual attention, possibly focusing on the potential role of perceived threat. (shrink)

Recognition of the identity of familiar faces in conditions with poor visibility or over large changes in head angle, lighting and partial occlusion is far more accurate than recognition of unfamiliar faces in similar conditions. Here we used a visual search paradigm to test if one class of social cues transmitted by faces – direction of another’s attention as conveyed by gaze direction and head orientation – is perceived more rapidly in personally familiar faces than in unfamiliar faces. We (...) found a strong effect of familiarity on the detection of these social cues, suggesting that the times to process these signals in familiar faces are markedly faster than the corresponding processing times for unfamiliar faces. In the light of these new data, hypotheses on the organization of the visual system for processing faces are formulated and discussed. (shrink)

This article reviews research into the attention mechanisms underlying a critical behavior in social interactions. It discusses findings from studies that investigate social gaze as a cue to attention and considers the perceptual mechanisms that may underlie these effects and their possible social functions. There is still debate as to whether gaze stimuli are “special” in terms of the attention processes engaged. However, there is evidence for the distinctive nature of gaze cues in their involvement in other (...) aspects of social perception such as person identity and emotional expression perception. Further, the sensitivity to another person's gaze direction varies across individuals within normal populations and in clinical populations, and these individual differences provide further insights into the key role of gaze cues in social cognition. (shrink)

ABSTRACTGaze-cuing refers to the spontaneous orienting of attention towards a gazed-at location, characterised by shorter response times to gazed-at than non-gazed at targets. Previous research suggests that processing of these gaze cues interacts with the processing of facial expression cues to enhance gaze-cuing. However, whether only negative emotions can enhance gaze-cuing is still debated, and whether this emotional modulation varies as a function of individual differences still remains largely unclear. Combining data from seven experiments, we investigated the (...) emotional modulation of gaze-cuing in the general population as a function of participant sex, and self-reported subclinical trait anxiety, depression, and autistic traits. We found that emotional enhancement of gaze-cuing can occur for both positive and negative expressions, the higher the score on the Attention to Detail subscale of the Autism Spectrum Quotient, the smaller the emotiona... (shrink)

Gaze direction signals another person’s focus of interest. Facial expressions convey information about their mental state. Appropriate responses to these signals should reflect their combined influence, yet current evidence suggests that gaze-cueing effects for objects near an observed face are not modulated by its emotional expression. Here, we extend the investigation of perceived gaze direction and emotional expression by considering their combined influence on affective judgments. While traditional response-time measures revealed equal gaze-cueing effects for (...) happy and disgust faces, affective evaluations critically depended on the combined product of gaze and emotion. Target objects looked at with a happy expression were liked more than objects looked at with a disgust expression. Objects not looked at were rated equally for both expressions. Our results demonstrate that facial expression does modulate the way that observers utilize gaze cues: Objects attended by others are evaluated according to the valence of their facial expression. C 2006 Elsevier B.V. All rights reserved. (shrink)

This study investigated eye-movement patterns during emotion perception for children with hearing aids and hearing children. Seventy-eight participants aged from 3 to 7 were asked to watch videos with a facial expression followed by an oral statement, and these two cues were either consistent or inconsistent in emotional valence. Results showed that while normal-hearing children paid more attention to the upper part of the face, children with hearing aids paid more attention to the lower face after the oral statement was (...) presented. When there was an inconsistency between the visual and auditory cues, children with hearing aids were likely to increase attention to the upper face. The results revealed the underlying mechanism of deficits in emotion perception for hearing-impaired children. (shrink)

Observing averted eye gaze results in the automatic allocation of attention to the gazed-at location. The role of the orientation of the face that produces the gaze cue was investigated. The eyes in the face could look left or right in a head-centred frame, but the face itself could be oriented 90 degrees clockwise or anticlockwise such that the eyes were gazing up or down. Significant cueing effects to targets presented to the left or right of the (...) screen were found in these head orientation conditions. This suggests that attention was directed to the side to which the eyes would have been looking towards, had the face been presented upright. This finding provides evidence that head orientation can affect gaze following, even when the head orientation alone is not a social cue. It also shows that the mechanism responsible for the allocation of attention following a gaze cue can be influenced by intrinsic object-based (i.e. head-centred) properties of the task-irrelevant cue. (shrink)

Looking times and gaze behavior indicate that infants can predict the goal state of an observed simple action event (e.g., object‐directed grasping) already in the first year of life. The present paper mainly focuses on infants’ predictive gaze‐shifts toward the goal of an ongoing action. For this, infants need to generate a forward model of the to‐be‐obtained goal state and to disengage their gaze from the moving agent at a time when information about the action event is (...) still incomplete. By about 6 months of age, infants show goal‐predictive gaze‐shifts, but mainly for familiar actions that they can perform themselves (e.g., grasping) and for familiar agents (e.g., a human hand). Therefore, some theoretical models have highlighted close relations between infants’ ability for action‐goal prediction and their motor development and/or emerging action experience. Recent research indicates that infants can also predict action goals of familiar simple actions performed by non‐human agents (e.g., object‐directed grasping by a mechanical claw) when these agents display agency cues, such as self‐propelled movement, equifinality of goal approach, or production of a salient action effect. This paper provides a review on relevant findings and theoretical models, and proposes that the impacts of action experience and of agency cues can be explained from an action‐event perspective. In particular, infants’ goal‐predictive gaze‐shifts are seen as resulting from an interplay between bottom‐up processing of perceptual information and top‐down influences exerted by event schemata that store information about previously executed or observed actions. (shrink)

Eye gaze is a ubiquitous cue in child–caregiver interactions, and infants are highly attentive to eye gaze from very early on. However, the question of why infants show gaze-sensitive behavior, and what role this sensitivity to gaze plays in their language development, is not yet well-understood. To gain a better understanding of the role of eye gaze in infants' language learning, we conducted a broad systematic review of the developmental literature for all studies that investigate (...) the role of eye gaze in infants' language development. Across 77 peer-reviewed articles containing data from typically developing human infants in the domain of language development, we identified two broad themes. The first tracked the effect of eye gaze on four developmental domains: vocabulary development, word–object mapping, object processing, and speech processing. Overall, there is considerable evidence that infants learn more about objects and are more likely to form word–object mappings in the presence of eye gaze cues, both of which are necessary for learning words. In addition, there is good evidence for longitudinal relationships between infants' gaze following abilities and later receptive and expressive vocabulary. However, many domains are understudied; further work is needed to decide whether gaze effects are specific to tasks, such as word–object mapping or whether they reflect a general learning enhancement mechanism. The second theme explored the reasons why eye gaze might be facilitative for learning, addressing the question of whether eye gaze is treated by infants as a specialized socio-cognitive cue. We concluded that the balance of evidence supports the idea that eye gaze facilitates infants' learning by enhancing their arousal, memory, and attentional capacities to a greater extent than other low-level attentional cues. However, as yet, there are too few studies that directly compare the effect of eye gaze cues and non-social, attentional cues for strong conclusions to be drawn. We also suggest that there might be a developmental effect, with eye gaze, over the course of the first 2 years of life, developing into a truly ostensive cue that enhances language learning across the board. (shrink)

The ability to communicate intentionally begins when infants start referring to external objects. Although social gaze has specific communicative functions, it remains unclear what they are. Beyond dyadic—infant-parent—emotional sharing, infant social gaze within the infant-parent-object triad becomes an increasingly complex communicative modality. We argue that the communicative function of infant social gaze is driven by the knowledge shared between the infant and the parent on the referent of the social gaze, namely the object. Although objects have (...) affordances, they are used in conventional ways shared between users (i.e. common ground). Parents transmit to infants the conventional use of objects, which infants progressively learn and master. Accordingly, we hypothesize that within triadic interactions, the communicative function of infant’s gaze toward the parent is shaped by the degree of common ground shared between the two communicative partners on the conventional use of the object. Based on three prototypical vignettes of mother-infant joint toy play sessions of one 8 month-old child and of two 16 month-old children, we provide a qualitative analysis of the function of infant gaze based on 1) infant’s mastery of the conventional use of the toy, and 2) the parental response to the infant’s gaze. Analyses of gaze patterns reveal that when infants do not master object’s conventional use, parents do not interpret infant’s gaze as meaningful. Conversely, when the infant masters object’s conventional use and thus shares with the parent common ground about the object, parents more likely interpret infant’s gaze as meaningful. Our findings highlight the key role that socio-materiality plays in early communicative development. Namely, when referring to objects for which the infant and the parent share common ground, the function of infant’s social gaze becomes communicatively meaningful for the parent. The knowledge on the communicative referent (i.e. the object) shared between the infant and the parent shapes the course of communicative behavior, constitutes and reflects the interactive function of gaze, and cues parents into tailoring their communicative response according to infant’s developmental needs, which in turns feeds back into infant’s learning and development. (shrink)

: The ability to respond to gaze cueing is essential for successful social interactions and social learning. An active area of research in human robot interactions focuses on the computational encoding of biologically realistic gaze cueing responses in robots. Studies of human development are a primary source of guidance for this field of research. The investigation of how perceived gazes constrain the developmental trajectories of visual attention in humans from childhood to adulthood might reveal important factors (...) to implement realistic gaze following in social robots. This study investigated spontaneous gaze following in 2 and 4-year-old children and adults. Participants saw faces of an adult gazing toward an object. We found that accuracy of gaze following improved significantly with age. The results are discussed considering the development of the executive control of visual attention in humans and its possible implication in implementing gaze following in social robotics. Keywords: Gaze Following; Eye Tracking; Visual Attention; Social Robotics; Developmental Trajectories Ispirare la robotica: traiettorie evolutive della capacità di seguire la direzione dello sguardo negli esseri umani Riassunto: La capacità di seguire la direzione dello sguardo è essenziale per il successo delle interazioni sociali e per l’apprendimento sociale. Un’area di ricerca particolarmente attiva nell’ambito dell’interazione uomo-robot si focalizza sulla codifica computazionale della capacità di seguire la direzione dello sguardo nei robot. Studiare come la capacità di seguire lo sguardo possa influenzare l’attenzione visiva negli esseri umani dall’infanzia all’età adulta può rivelare importanti informazioni per implementare la capacità di seguire lo sguardo nei robot sociali. Questo studio ha indagato la capacità spontanea di seguire la direzione dello sguardo in bambini di 2 e 4 anni e negli adulti. I partecipanti hanno osservato una serie di volti umani con lo sguardo rivolto verso un oggetto. I risultati hanno indicato che l’accuratezza nel gaze following migliora in modo significativo con l’età. I risultati sono stati discussi considerando il ruolo del controllo esecutivo dell’attenzione visiva negli esseri umani e le sue possibili implicazioni per implementare l’abilità di seguire la direzione dello sguardo nei robot sociali. Parole chiave: Seguire la direzione dello sguardo; Eye Tracking; Attenzione visiva; Robot sociali; Traiettorie evolutive. (shrink)

Infants can see someone pointing to one of two buckets and infer that the toy they are seeking is hidden inside. Great apes do not succeed in this task, but, surprisingly, domestic dogs do. However, whether children and dogs understand these communicative acts in the same way is not yet known. To test this possibility, an experimenter did not point, look, or extend any part of her body towards either bucket, but instead lifted and shook one via a centrally pulled (...) rope. She did this either intentionally or accidentally, and did or did not address her act to the subject using ostensive cues. Young 2-year-old children but not dogs understood the experimenter’s act in intentional conditions. While ostensive pulling of the rope made no difference to children’s success, it actually hindered dogs’ performance. We conclude that while human children may be capable of inferring communicative intent from a wide variety actions, so long as these actions are performed intentionally, dogs are likely to be less flexible in this respect. Their understanding of communicative intention may be more dependent upon bodily markers of communicative intent, including gaze, orientation, extended limbs, and vocalisations. This may be because humans have come under selective pressure to develop skills for communicating with absent interlocutors – where bodily co-presence is not possible. (shrink)

Gaze direction is an important social cue for understanding the intentions of other people. Indeed, interacting with others requires the ability to encode their current focus of attention in order to predict their future actions. Previous studies have showed that when asked to detect or identify a target, people are faster if shown a gaze oriented toward rather than away from that target. Most importantly, there is evidence that the emotion conveyed by the face with the averted (...) class='Hi'>gaze matters. We further tested the interplay between gaze and face emotion in the context of manipulable objects to understand whether and to what extent other people's gaze influences our own actions toward objects. Participants judged whether a target graspable object was upright or inverted after viewing a face cue with a central or averted gaze. Importantly, the target's handle could be oriented toward the gazed-at location or the opposite side such that gaze and handle were corresponding or non-corresponding in space. Furthermore, we manipulated the expression of the cue by using neutral and fearful faces. Results showed a handle-response compatibility effect only with fearful cues with a central gaze. (shrink)

The previous studies have shown that human infants and domestic dogs follow the gaze of a human agent only when the agent has addressed them ostensively—e.g., by making eye contact, or calling their name. This evidence is interpreted as showing that they expect ostensive signals to precede referential information. The present study tested chimpanzees, one of the closest relatives to humans, in a series of eye-tracking experiments using an experimental design adapted from these previous studies. In the ostension conditions, (...) a human actor made eye contact, called the participant’s name, and then looked at one of two objects. In the control conditions, a salient cue, which differed in each experiment (a colorful object, the actor’s nodding, or an eating action), attracted participants’ attention to the actor’s face, and then the actor looked at the object. Overall, chimpanzees followed the actor’s gaze to the cued object in both ostension and control conditions, and the ostensive signals did not enhance gaze following more than the control attention-getters. However, the ostensive signals enhanced subsequent attention to both target and distractor objects (but not to the actor’s face) more strongly than the control attention-getters—especially in the chimpanzees who had a close relationship with human caregivers. We interpret this as showing that chimpanzees have a simple form of communicative expectations on the basis of ostensive signals, but unlike human infants and dogs, they do not subsequently use the experimenter’s gaze to infer the intended referent. These results may reflect a limitation of non-domesticated species for interpreting humans’ ostensive signals in inter-species communication. (shrink)

The communicative interactions of very young children almost always involve language, gesture and directed gaze. In this study, ninety-six children were asked to determine the location of a hidden toy by understanding a communicative act that contained none of these familiar means. A light-and-sound mechanism placed behind the hiding place and illuminated by a centrally placed switch was used to indicate the location of the toy. After a communicative training session, an experimenter pressed the switch either deliberately or accidentally, (...) and with or without ostension. In no condition did she orient towards the hiding place. When the switch was pressed intentionally, children used the light-and-sound cue to find the toy – and tended to do so even in the absence of ostensive eye contact. When the experimenter pressed the switch accidentally, children searched randomly – demonstrating that they were tracking her communicative intent, and not merely choosing on the basis of salience. The absence of an effect of ostension contradicts research that ostension helps children to interpret the communicative intentions underlying unfamiliar signs. We explain this by concluding that while it may play a role in establishing a communicative interaction, it is not necessary for sustaining one; and that even with a highly novel communicative act – involving none of the means of communication on which children typically rely – three-year-olds can comprehend the communicative intentions behind an intentionally produced act. (shrink)

We are highly tuned to each other's visual attention. Perceiving the eye or hand movements of another person can influence the timing of a saccade or the reach of our own. However, the explanation for such spatial orienting in interpersonal contexts remains disputed. Is it due to the social appearance of the cue—a hand or an eye—or due to its social relevance—a cue that is connected to another person with attentional and intentional states? We developed an interpersonal version of the (...) Posner spatial cueing paradigm. Participants saw a cue and detected a target at the same or a different location, while interacting with an unseen partner. Participants were led to believe that the cue was either connected to the gaze location of their partner or was generated randomly by a computer (Experiment 1), and that their partner had higher or lower social rank while engaged in the same or a different task (Experiment 2). We found that spatial cue‐target compatibility effects were greater when the cue related to a partner's gaze. This effect was amplified by the partner's social rank, but only when participants believed their partner was engaged in the same task. Taken together, this is strong evidence in support of the idea that spatial orienting is interpersonally attuned to the social relevance of the cue—whether the cue is connected to another person, who this person is, and what this person is doing—and does not exclusively rely on the social appearance of the cue. Visual attention is not only guided by the physical salience of one's environment but also by the mental representation of its social relevance. (shrink)

In online lectures, unlike in face-to-face lectures, teachers lack access to (nonverbal) cues to check if their students are still “with them” and comprehend the lecture. The increasing availability of low-cost eye-trackers provides a promising solution. These devices measure unobtrusively where students look and can visualize these data to teachers. These visualizations might inform teachers about students’ level of “with-me-ness” (i.e., do students look at the information that the teacher is currently talking about) and comprehension of the lecture, provided that (...) (1) gaze measures of “with-me-ness” are related to comprehension, (2) people not trained in eye-tracking can predict students’ comprehension from gaze visualizations, (3) we understand how different visualization techniques impact this prediction. We addressed these issues in two studies. In Study 1, 36 students watched a video lecture while being eye-tracked. The extent to which students looked at relevant information and the extent to which they looked at the same location as the teacher both correlated with students’ comprehension (score on an open question) of the lecture. In Study 2, 50 participants watched visualizations of students’ gaze (from Study 1), using six visualization techniques (dynamic and static versions of scanpaths, heatmaps, and focus maps) and were asked to predict students’ posttest performance and to rate their ease of prediction. We found that people can use gaze visualizations to predict learners’ comprehension above chance level, with minor differences between visualization techniques. Further research should investigate if teachers can act on the information provided by gaze visualizations and thereby improve students’ learning. (shrink)

For decades the study of social perception was largely compartmentalized by type of social cue: race, gender, emotion, eye gaze, body language, facial expression etc. This was partly due to good scientific practice, and partly due to assumptions that each type of social cue was functionally distinct from others. Herein, we present a functional forecast approach to understanding compound social cue processing that emphasizes the importance of shared social affordances across various cues. We review the traditional theories of emotion (...) and face processing that argued for dissociable and noninteracting pathways, as well as more recent evidence for combinatorial processing of social cues. We argue here that early, and presumably reflexive, visual integration of such cues is necessary for adaptive behavioral responding to others. In support of this claim, we review contemporary work that reveals a flexible visual system, one that readily incorporates meaningful contextual influences in even nonsocial visual processing, thereby establishing the functional and neuroanatomical bases necessary for compound social cue integration. Finally, we explicate three likely mechanisms driving such integration. Together, this work implicates a role for cognitive penetrability in visual perceptual abilities that have often been ascribed to direct encapsulated perceptual processes. (shrink)

Young children often treat robots as social agents after they have witnessed interactions that can be interpreted as social. We studied in three experiments whether four-year-olds from three cultures and adults from two cultures will attribute ownership of objects to a robot that engages in social gaze with a human. Participants watched videos of robot-human interactions, in which objects were possessed or new objects were created. Children and adults applied the same ownership rules to humans and robots – irrespective (...) of whether the robot engaged in social gaze or not. However, there was cultural variation in the types of ownership rules used. In Experiment 3, we removed further social cues, finding that just showing a pair of self-propelled robot-arms elicited ownership attributions. The role of social gaze in social attributions to robots and cross-cultural differences in ownership understanding are discussed. (shrink)

Three experiments investigated the nature of visuo-auditory crossmodal cueing in a triadic setting: participants had to detect an auditory signal while observing another agent’s head facing one of the two laterally positioned auditory sources. Experiment 1 showed that when the agent’s eyes were open, sounds originating on the side of the agent’s gaze were detected faster than sounds originating on the side of the agent’s visible ear; when the agent’s eyes were closed this pat-tern of responses was reversed. (...) Two additional experiments showed that the results were sensitive to whether participants could infer a hearing function on the part of the agent. When no ear was depicted on the agent, only a gaze-side advantage was observed , but when the agent’s ear was covered , an ear side advantage was observed only when hearing could still be inferred but not when hearing was inferred to be diminished . The findings are discussed in the context of inferential and simulation processes and joint attention mechanisms. (shrink)

Although eye tracking has been used extensively to assess cognitions for static stimuli, recent research suggests that the link between gaze and cognition may be more tenuous for dynamic stimuli such as videos. Part of the difficulty in convincingly linking gaze with cognition is that in dynamic stimuli, gaze position is strongly influenced by exogenous cues such as object motion. However, tests of the gaze‐cognition link in dynamic stimuli have been done on only a limited range (...) of stimuli often characterized by highly organized motion. Also, analyses of cognitive contrasts between participants have been mostly been limited to categorical contrasts among small numbers of participants that may have limited the power to observe more subtle influences. We, therefore, tested for cognitive influences on gaze for screen‐captured instructional videos, the contents of which participants were tested on. Between‐participant scanpath similarity predicted between‐participant similarity in responses on test questions, but with imperfect consistency across videos. We also observed that basic gaze parameters and measures of attention to centers of interest only inconsistently predicted learning, and that correlations between gaze and centers of interest defined by other‐participant gaze and cursor movement did not predict learning. It, therefore, appears that the search for eye movement indices of cognition during dynamic naturalistic stimuli may be fruitful, but we also agree that the tyranny of dynamic stimuli is real, and that links between eye movements and cognition are highly dependent on task and stimulus properties. (shrink)

Since social skills are highly significant to the evolutionary success of humans, we should expect these skills to be efficient and reliable. For many Evolutionary Psychologists efficiency entails encapsulation: the only way to get an efficient system is via information encapsulation. But encapsulation reduces reliability in opaque epistemic domains. And the social domain is darkly opaque: people lie and cheat, and deliberately hide their intentions and deceptions. Modest modularity [Currie and Sterelny (2000) Philos Q 50:145–160] attempts to combine efficiency and (...) reliability. Reliability is obtained by placing social skills in un-encapsulated central cognition; efficiency by having the social system sensitive to encapsulated socially tagged cues. In this paper, I argue that this approach fails. I focus on eye-gaze as a plausible example of a socially significant encapsulated cue. I demonstrate contra modest modularity that eye-gaze is subject to influence from central cognition. (shrink)

The pupils of the eyes reflexively constrict in light and dilate in dark to optimize retinal illumination. Non-visual cognitive factors, like attention, arousal, decision-making, etc., also influence pupillary light response. During passive viewing, the eccentricity of a stimulus modulates the pupillary aperture size driven by spatially weighted corneal flux density, which is the product of luminance and the area of the stimulus. Whether the scope of attention also influences PLR remains unclear. In this study, we contrasted the pupil dynamics between (...) diffused and focused attentional conditions during decision-making, while the global CFD remained the same in the two conditions. A population of 20 healthy humans participated in a pair of forced choice tasks. They distributed attention to the peripheral decision cue in one task, and concentrated at the center in the other to select the target from four alternatives for gaze orientation. The location of this cue did not influence participants’ reaction time. However, the magnitude of constriction was significantly less in the task that warranted attention to be deployed at the center than on the periphery. We observed similar pupil dynamics when participants either elicited or canceled a saccadic eye movement, which ruled out pre-saccadic obligatory attentional orientation contributing to PLR. We further addressed how the location of attentional deployment might have influenced PLR. We simulated a biomechanical model of PLR with visual stimulation of different strengths as inputs corresponding to the two attentional conditions. In this homeomorphic model, the computational characteristic of each element was derived from the physiological and/or mechanical properties of the corresponding biological element. The simulation of this model successfully mimicked the observed data. In contrast to common belief that the global ambient luminosity drives pupillary response, the results of our study suggest that the effective CFD determined via the luminance multiplied by the size of the stimulus at the location of deployed attention in the visual space is critical for the magnitude of pupillary constriction. (shrink)

Infants acquire their first words through interactions with social partners. In the first year of life, infants receive a high frequency of visual and auditory input from faces, making faces a potential strong social cue in facilitating word-to-world mappings. In this position paper, we review how and when infant gaze to faces is likely to support their subsequent vocabulary outcomes. We assess the relevance of infant gaze to faces selectively, in three domains: infant gaze to different features (...) within a face ; then to faces ; and finally to more socially relevant types of faces. We argue that infant gaze to faces could scaffold vocabulary construction, but its relevance may be impacted by the developmental level of the infant and the type of task with which they are presented. Gaze to faces proves relevant to vocabulary, as gazes to eyes could inform about the communicative nature of the situation or about the labeled object, while gazes to the mouth could improve word processing, all of which are key cues to highlighting word-to-world pairings. We also discover gaps in the literature regarding how infants’ gazes to faces or to different types of faces relate to vocabulary outcomes. An important direction for future research will be to fill these gaps to better understand the social factors that influence infant vocabulary outcomes. (shrink)

The capacity to extract socially relevant information from faces is fundamental to normal reciprocal social interactions and communication. The psychophysical evidence reviewed here demonstrates that humans possess a perceptual apparatus sensitive enough to detect the visual features which are informative of gaze in many face-to-face situations. This article provides evidence for the existence of three functionally and neuroanatomically dissociable eye gaze processing systems. Eye gaze also represents a class of biological motion cues, which engage the posterior superior (...) temporal sulcus for the analysis of intentions and psychological dispositions. Outputs from the anterior superior temporal sulcus constrain processing in the pSTS, linking the observed direction of gaze towards an object or person in the environment with the mentalistic information provided by the gaze shift. A few promising research directions for the field are highlighted. (shrink)

Past research demonstrates that emotion recognition is influenced by social category cues present on faces. However, little research has investigated whether holistic processing is required to observe these influences of social category information on emotion perception, and no studies have investigated whether different visual sampling strategies (i.e. differences in the allocation of attention to different regions of the face) contribute to the interaction between social cues and emotional expressions. The current study aimed to address this. Participants categorised happy and angry (...) expressions on own- and other-race faces, and male and female faces. In Experiments 1 and 2, holistic processing was disrupted by presenting inverted faces (Experiment 1) or part faces (Experiment 2). In Experiments 3 and 4 participants’ eye-gaze to eye and mouth regions was also tracked. Disrupting holistic processing did not alter the moderating influence of sex and race cues on emotion recognition (Experiments 1, 2, 4). Gaze patterns differed as a function of emotional expression, and social category cues, however, eye-gaze patterns did not reflect response time patterns (Experiments 3 and 4). Results indicate that the interaction between social category cues and emotion does not require holistic processing and is not driven by differences in visual sampling. (shrink)

My commentary focusses on the anecdote described by Elise v. Bernstorff in her research on transcultural education in rural Germany. I am interested in the potential intersections between v. Bernstorff’s findings and my own work on postcolonial literary theory and translation studies. On a methodological level, I am taking my cue from the ethical theory of the Caribbean philosopher Édouard Glissant on the one hand and postcolonial translation studies (Spivak, Tymoczko, Venuti) on the other.