How important is the ability to freely control eye movements for reading comprehension? And how does the parser make use of this freedom? We investigated these questions using coregistration of eye movements and event‐related brain potentials (ERPs) while participants read either freely or in a computer‐controlled word‐by‐word format (also known as RSVP). Word‐by‐word presentation and natural reading both elicited qualitatively similar ERP effects in response to syntactic and semantic violations (N400 and P600 effects). Comprehension was better in free reading but (...) only in trials in which the eyes regressed to previous material upon encountering the anomaly. A more fine‐grained ERP analysis revealed that these regressions were strongly associated with the well‐known P600 effect. In trials without regressions, we instead found sustained centro‐parietal negativities starting at around 320 ms post‐onset; however, these negativities were only found when the violation occurred in sentence‐final position. Taken together, these results suggest that the sentence processing system engages in strategic choices: In response to words that don't match built‐up expectations, it can either explore alternative interpretations (reflected by regressions, P600 effects, and good comprehension) or pursue a “good‐enough” processing strategy that tolerates a deficient interpretation (reflected by progressive saccades, sustained negativities, and relatively poor comprehension). (shrink)

The focus of this chapter is the relationship between synaesthesia, attention and eye movements. The measurement of eye movements as a core experimental tool for gaining insight into complex cognitive processes in general and attentional mechanisms more specifically, is now firmly established. By means of eye movements, the neural basis of higher cognitive processes, such as target selection, working memory, and response suppression, can be investigated. It therefore seems logical that eye movement recordings can also be used to investigate (...) a complex phenomenon like synaesthesia. In this chapter, we will start with a section summarizing the relationship between eye movements and attention in general. Then the focus moves to synaesthesia and what we currently know about synaesthesia based on the method of measuring eye movements. Finally, we discuss pupillometry which provides a window on changes in the 'allocation' of attention and the 'consolidation' of perception. Consequently, it offers a useful technique for probing 'changes' in mental states due synaesthetic perceptions. (shrink)

ABSTRACTThe present study examined the effects of emotions on eye movements, head motion, and iPad motion during reading. Thirty-one participants read neutral, emotionally negative texts and emotio...

We investigated the coupling between a speaker's and a listener's eye movements. Some participants talked extemporaneously about a television show whose cast members they were viewing on a screen in front of them. Later, other participants listened to these monologues while viewing the same screen. Eye movements were recorded for all speakers and listeners. According to cross-recurrence analysis, a listener's eye movements most closely matched a speaker's eye movements at a delay of 2 sec. Indeed, the more closely a listener's (...) eye movements were coupled with a speaker's, the better the listener did on a comprehension test. In a second experiment, low-level visual cues were used to manipulate the listeners' eye movements, and these, in turn, influenced their latencies to comprehension questions. Just as eye movements reflect the mental state of an individual, the coupling between a speaker's and a listener's eye movements reflects the success of their communication. (shrink)

Existing research shows that people can improve their decision skills by learning what experts paid attention to when faced with the same problem. However, in domains like financial education, effective instruction requires frequent, personalized feedback given at the point of decision, which makes it time‐consuming for experts to provide and thus, prohibitively costly. We address this by demonstrating an automated feedback mechanism that allows amateur decision‐makers to learn what information to attend to from one another, rather than from an expert. (...) In the first experiment, eye movements of N = 100 subjects were recorded while they repeatedly performed a standard behavioral finance investment task. Consistent with previous studies, we found that a significant proportion of subjects were affected by decision bias. In the second experiment, a different group of N = 100 subjects faced the same task but, after each choice, they received individual, machine learning‐generated feedback on whether their pre‐decision eye movements resembled those made by Experiment 1 subjects prior to good decisions. As a result, Experiment 2 subjects learned to analyze information similarly to their successful peers, which in turn reduced their decision bias. Furthermore, subjects with low Cognitive Reflection Test scores gained more from the proposed form of process feedback than from standard behavioral feedback based on decision outcomes. (shrink)

The hypothesis that word representations are emotionally impoverished in a second language (L2) has variable support. However, this hypothesis has only been tested using tasks that present words in isolation or that require laboratory-specific decisions. Here, we recorded eye movements for 34 bilinguals who read sentences in their L2 with no goal other than comprehension, and compared them to 43 first language readers taken from our prior study. Positive words were read more quickly than neutral words in the L2 across (...) first-pass reading time measures. However, this emotional advantage was absent for negative words for the earliest measures. Moreover, negative words but not positive words were influenced by concreteness, frequency and L2 proficiency in a manner similar to neutral words. Taken together, the findings suggest that only negative words are at risk of emotional disembodiment during L2 reading, perhaps because a positivity bias in L2 experiences ensures that positive words are emotionally grounded. (shrink)

Inattentional Blindness occurs when observers engaged in resource-consuming tasks fail to see unexpected stimuli that appear in their visual field. Eye movements were recorded in a dynamic IB task where participants tracked targets amongst distractors. During the task, an unexpected stimulus crossed the screen for several seconds. Individuals who failed to report the unexpected stimulus were deemed to be IB. Being IB was associated with making more fixations and longer gaze times on distractor stimuli, being less likely to fixate the (...) unexpected stimulus, and having lower working memory capacity than those who were not IB. Noticing the unexpected stimulus was not contingent upon fixating it, suggesting that some individuals processed the unexpected stimulus via covert attention. The findings support earlier research on working memory and IB. In addition, IBs were less efficient attentional allocators than those who were not IB, as reflected in their eye tracking of irrelevant distractors. (shrink)

Eye movements are a vital part of our interaction with the world. They play a pivotal role in perception, cognition, and education. This book is unique in tracing the history of eye movement research. It shows how great strides were made in this area long before modern recording devices were available. Anyone interested in the origins of psychology and neuroscience will find much to stimulate and surprise them in this valuable new work.

Eye movements were recorded during the display of two images of a real-world scene that were inspected to determine whether they were the same or not . In the displays where the pictures were different, one object had been changed, and this object was sometimes taken from another scene and was incongruent with the gist. The experiment established that incongruous objects attract eye fixations earlier than the congruous counterparts, but that this effect is not apparent until the picture has been (...) displayed for several seconds. By controlling the visual saliency of the objects the experiment eliminates the possibility that the incongruency effect is dependent upon the conspicuity of the changed objects. A model of scene perception is suggested whereby attention is unnecessary for the partial recognition of an object that delivers sufficient information about its visual characteristics for the viewer to know that the object is improbable in that particular scene, and in which full identification requires foveal inspection. (shrink)

Frontiers Events is a rapidly growing calendar management system dedicated to the scheduling of academic events. This includes announcements and invitations, participant listings and search functionality, abstract handling and publication, related events and post-event exchanges. Whether an organizer or participant, make your event a Frontiers Event!

The present study examined whether cinematographic editing density affects viewers’ perception of time. As a second aim, based on embodied models that conceive time perception as strictly connected to the movement, we tested the hypothesis that the editing density of moving images also affects viewers’ eye movements and that these later mediate the effect of editing density on viewers’ temporal judgments. Seventy participants watched nine video clips edited by manipulating the number of cuts (slow‐ and fast‐paced editing against a (...) master shot, unedited condition). For each editing density, multiple video clips were created, representing three different kinds of routine actions. The participants’ eye movements were recorded while watching the video, and the participants were asked to report duration judgments and subjective passage of time judgments after watching each clip. The results showed that participants subjectively perceived that time flew more while watching fast‐paced edited videos than slow‐paced or unedited videos; by contrast, concerning duration judgments, participants overestimated the duration of fast‐paced videos compared to the master‐shot videos. Both the slow‐ and the fast‐paced editing generated shorter fixations than the master shot, and the fast‐paced editing led to shorter fixations than the slow‐paced editing. Finally, compared to the unedited condition, editing led to an overestimation of durations through increased eye mobility. These findings suggest that the editing density of moving images by increasing the number of cuts effectively altered viewers’ experience of time and add further evidence to prior research showing that performed eye movement is associated with temporal judgments. (shrink)

Paralleling the recent work by Reichle, Reineberg, and Schooler , we explore the use of eye movements as an objective measure of mind wandering while participants performed a reading task. Participants were placed in a self-classified probe-caught mind wandering paradigm while their eye movements were recorded. They were randomly probed every 2–3 min and were required to indicate whether their mind had been wandering. The results show that eye movements were generally less complex when participants reported mind wandering episodes, with (...) both duration and frequency of within-word regressions, for example, becoming significantly reduced. This is consistent with the theoretical claim that the cognitive processes that normally influence eye movements to enhance semantic processing during reading exert less control during mind wandering episodes. (shrink)

Eye movements are a vital part of our interaction with the world. They play a pivotal role in perception, cognition, and education. This book is unique in tracing the history of eye movement research. It shows how great strides were made in this area long before modern recording devices were available. Anyone interested in the origins of psychology and neuroscience will find much to stimulate and surprise them in this valuable new work.

We report an eye movement experiment that investigates the effects of collocation strength and contextual predictability on the reading of collocative phrases by L2 English readers. Thirty-eight Chinese English as foreign language learners read 40 sentences, each including a specific two-word phrase that was either a strong or weak adjective-noun collocation and was either highly predictable or unpredictable from the previous sentence context. Eye movement measures showed that L2 reading times for the collocative phrases were sensitive to both (...) collocation strength and contextual predictability. However, an interaction effect between these factors, which appeared relatively late in the eye movement record, additionally revealed that contextual predictability more strongly influenced time spent reading weak compared with strong collocations. This was most likely because the greater familiarity of strong collocations facilitated their integration, even in the absence of strong contextual constraint. We discuss the findings in terms of the value of collocations in second language learning. (shrink)

To explore the influences of traffic-related negative emotions on driving decisions, we induced drivers’ three emotions by videos, then the drivers were shown traffic pictures at different risk levels and made decisions about whether to slow down, while their eye movements were recorded. We found that traffic-related negative emotion influenced driving decisions. Compared with neutral emotion, traffic-related negative emotion led to an increase in the number of decelerations, and the higher the risk, the more the number of decelerations. The visual (...) processing time of the risk area was shorter in the traffic-related negative emotional state than that in the neutral emotional state. The less time drivers spend looking at the risk area, the faster they make their driving decisions. The results suggest that traffic-related negative emotions lead drivers to make more conservative decisions. This study supports the rationality of using traffic accident materials to conduct safety education for drivers. This article also discussed the significance of traffic-related negative emotions to social security. (shrink)

Punning is an important means of creating humorous effects by intentionally exploiting semantic ambiguity. Previous psycholinguistic research on puns has mainly focused on the process of meaning retrieval in homograph puns, while it is still not entirely clear how readers dynamically utilize contextual information to understand homophone puns. In the current investigation, 68 native Chinese participants were recruited to read three types of experimental sentences while their eye movements were recorded: the homophone-pun sentences where the less salient homophone was visually (...) presented, the homophone-salient sentences where the salient homophone was used, and the homophone-error sentences where the critical context noun in the homophone puns was replaced with an unrelated word. Humor rating results of the homophone puns and the homophone-salient sentences demonstrated that the less salient homophones rather than the salient ones elicited much larger humor responses when presented visually in the same potential pun context. In addition, the reverse fixation pattern in the homophone area and the spill-over region also suggested that meanings of the salient homophones were more recoverable even when not presented visually. Statistical analyses of the homophone puns and the homophone-error sentences showed that the semantic relatedness between the critical context noun and the less salient homophone could significantly predict the humor rating scores of Chinese readers. Taken together, less salient homophones need to receive more contextual support to balance out the advantages of salient homophones before generating a humorous pun interpretation. (shrink)

Social attention is thought to require detecting the eyes of others and following their gaze. To be effective, observers must also be able to infer the person's thoughts and feelings about what he or she is looking at, but this has only rarely been investigated in laboratory studies. In this study, participants' eye movements were recorded while they chose which of four patterns they preferred. New observers were subsequently able to reliably guess the preference response by watching a replay of (...) the fixations. Moreover, when asked to mislead the person guessing, participants changed their looking behavior and guessing success was reduced. In a second experiment, naïve participants could also guess the preference of the original observers but were unable to identify trials which were lies. These results confirm that people can spontaneously use the gaze of others to infer their judgments, but also that these inferences are open to deception. (shrink)

We present a visual world eye-tracking study on Tseltal (a Mayan language) and investigate whether verbal information can be used to anticipate an upcoming referent. Basic word order in transitive sentences in Tseltal is Verb–Object–Subject (VOS). The verb is usually encountered first, making argument structure and syntactic information available at the outset, which should facilitate anticipation of the post-verbal arguments. Tseltal speakers listened to verb-initial sentences with either an object-predictive verb (e.g., “eat”) or a general verb (e.g., “look for”) (e.g., (...) “Ya slo’/sle ta stukel on te kereme,” Is eating/is looking (for) by himself the avocado the boy/ “The boy is eating/is looking (for) an avocado by himself”) while seeing a visual display showing one potential referent (e.g., avocado) and three distractors (e.g., bag, toy car, coffee grinder). We manipulated verb type (predictive vs. general) and recorded participants' eye movements while they listened and inspected the visual scene. Participants’ fixations to the target referent were analyzed using multilevel logistic regression models. Shortly after hearing the predictive verb, participants fixated the target object before it was mentioned. In contrast, when the verb was general, fixations to the target only started to increase once the object was heard. Our results suggest that Tseltal hearers pre-activate semantic features of the grammatical object prior to its linguistic expression. This provides evidence from a verb-initial language for online incremental semantic interpretation and anticipatory processing during language comprehension. These processes are comparable to the ones identified in subject-initial languages, which is consistent with the notion that different languages follow similar universal processing principles. (shrink)

Semantic studies on diagrammatic notations (Barwise & Etchemendy, ; Shimojima, ; Stenning & Lemon, ) have revealed that the “non-deductive,” “emergent,” or “perceptual” effects of diagrams (Chandrasekaran, Kurup, Banerjee, Josephson, & Winkler, ; Kulpa, ; Larkin & Simon, ; Lindsay, ) are all rooted in the exploitation of spatial constraints on graphical structures. Thus, theoretically, this process is a key factor in inference with diagrams, explaining the frequently observed reduction of inferential load. The purpose of this study was to examine (...) the empirical basis for this theoretical suggestion, focusing on the reality of the constraint-exploitation strategy in actual practices of diagrammatic reasoning. Eye movements were recorded while participants used simple position diagrams to solve three- or four-term transitive inference problems. Our experiments revealed that the participants could exploit spatial constraints on graphical structures even when (a) they were not in the position of actually manipulating diagrams, (b) the semantic rule for the provided diagrams did not match their preferences, and (c) the constraint-exploitation strategy invited a partly adverse effect. These findings indicate that the hypothesized process is in fact robust, with the potential to broadly account for the inferential advantage of diagrams. (shrink)

The study of eye movements is a common way to non-invasively understand and analyze human behavior. However, eye-tracking techniques are very hard to scale, and require expensive equipment and extensive expertise. In the context of web browsing, these issues could be overcome by studying the link between the eye and the computer mouse. Here, we propose new analysis methods, and a more advanced characterization of this link. To this end, we recorded the eye, mouse, and scroll movements of 151 participants (...) exploring 18 dynamic web pages while performing free viewing and visual search tasks for 20 s. The data revealed significant differences of eye, mouse, and scroll parameters over time which stabilize at the end of exploration. This suggests the existence of a task-independent relationship between eye, mouse, and scroll parameters, which are characterized by two distinct patterns: one common pattern for movement parameters and a second for dwelling/fixation parameters. Within these patterns, mouse and eye movements remained consistent with each other, while the scrolling behaved the opposite way. (shrink)

Eye-tracking technology has become a powerful tool for biomedical-related applications due to its simplicity of operation and low requirements on patient language skills. This study aims to use the machine-learning models and deep-learning networks to identify key features of eye movements in Alzheimer's Disease (AD) under specific visual tasks, thereby facilitating computer-aided diagnosis of AD. Firstly, a three-dimensional (3D) visuospatial memory task is designed to provide participants with visual stimuli while their eye-movement data are recorded and used to build (...) an eye-tracking dataset. Then, we propose a novel deep-learning-based model for identifying patients with Alzheimer's Disease (PwAD) and healthy controls (HCs) based on the collected eye-movement data. The proposed model utilizes a nested autoencoder network to extract the eye-movement features from the generated fixation heatmaps and a weight adaptive network layer for the feature fusion, which can preserve as much useful information as possible for the final binary classification. To fully verify the performance of the proposed model, we also design two types of models based on traditional machine-learning and typical deep-learning for comparison. Furthermore, we have also done ablation experiments to verify the effectiveness of each module of the proposed network. Finally, these models are evaluated by four-fold cross-validation on the built eye-tracking dataset. The proposed model shows 85% average accuracy in AD recognition, outperforming machine-learning methods and other typical deep-learning networks. (shrink)

It is often believed that attentional bias for food is a stable trait of certain groups, like restrained eaters. However, empirical evidence from this domain is inconsistent. High-calorie foods are double-faceted, as they are both a source of reward and of weight/health concern. Their meaning might depend on the food-related context, which in turn could affect AB for food. This study primed 85 females with hedonic, healthy, and neutral contexts successively and examined whether food-related context affected AB for food and (...) if effects were moderated by dietary restraint. Both the mean tendencies of AB for food and variability of AB for food were assessed in a food dot-probe task with a recording of both reaction times and eye movements. Contrary to our hypotheses, AB for food was not significantly affected by either context or the interaction between context and dietary restraint. Instead, liking of the presented food stimuli was related to longer initial fixations and longer dwell time on the food stimuli. In addition, in line with prior research, body mass index was correlated with variability of AB for food instead of mean AB for food. In conclusion, this study did not find any support that AB for food is dependent on food-related context, but interestingly, reaction time-based variability of AB for food seems to relate to BMI, and eye movement-based mean AB seems to relate to appetitive motivation. (shrink)

According to the dual-system theories, the decisions in an ultimatum game are governed by the automatic System 1 and the controlled System 2. The former drives the preference for fairness, whereas the latter drives the self-interest motive. However, the association between the contributions of the two systems in UG and the cognitive process needs more direct evidence. In the present study, we used the process dissociation procedure to estimate the contributions of the two systems and recorded participants eye movements to (...) examine the cognitive processes underlying UG decisions. Results showed that the estimated contributions of the two systems are uncorrelated and that they demonstrate a dissociated pattern of associations with third variables, such as reaction time and mean fixation duration. Furthermore, the relative time advantage and the transitions between the two payoffs can predict the final UG decisions. Our findings provide evidence for the independent contributions of preference for fairness and self-interest maximizing inclinations to UG and shed light on the underlying processes. (shrink)

ABSTRACTThe present study examined relationships between attention to negative words and daily rumination and daily adjustment in a sample of clinically depressed individuals. We recorded eye movements of 43 individuals diagnosed with major depression while they were freely viewing dysphoric, threat-related, neutral, and positive words. Then, each day for one week, participants provided measures of their daily rumination and psychological adjustment. Multilevel analyses found that attention to dysphoric and threat-related words was positively related to daily rumination and attention to threat-related (...) words was negatively related to daily adjustment. These findings suggest that the impaired ability to disengage from negative words is positively related to rumination in daily life and is negatively related to well-being, as defined in terms of Beck’s Triad. (shrink)

When people are asked to estimate the probabilities of uncertain events, they often neglect the additivity principle, which requires that the probabilities assigned to an exhaustive set of outcomes should add up to 100%. Previous studies indicate that additivity neglect is dependent on response format, self-generated probability estimates being more coherent than estimates on rating scales. The present study made use of eye-tracking methodology, recording the movement, frequency and duration of fixations during the solution of ten additivity problems (...) and two control tasks. Participants produced more non-additive estimates in the Scale format than in the Self-generated format. Self-generated estimates also led to longer decision time and a higher number of repeated inspections, suggesting a deliberate comparison process. In contrast, the Scale format seemed to encourage a case-based approach where each outcome is evaluated in isolation. (shrink)

We examined whether variations in contextual diversity, spacing, and retrieval practice influenced how well adults learned new words from reading experience. Eye movements were recorded as adults read novel words embedded in sentences. In the learning phase, unfamiliar words were presented either in the same sentence repeated four times (same context) or in four different sentences (diverse context). Spacing was manipulated by presenting the sentences under distributed or non‐distributed practice. After learning, half of the participants were asked to retrieve the (...) new words, and half had an extra exposure to the new words. Although words experienced in diverse contexts were acquired more slowly during learning, they enjoyed a greater benefit of learning at immediate posttest. Distributed practice also slowed learning, but no benefit was observed at posttest. Although participants who had an extra exposure showed the greatest learning benefit overall, learning also benefited from retrieval opportunity, when words were experienced in diverse contexts. These findings demonstrate that variation in the content and structure of the learning environment impacts on word learning via reading. (shrink)

Conversation is supported by the beliefs that people have in common and the perceptual experience that they share. The visual context of a conversation has two aspects: the information that is available to each conversant, and their beliefs about what is present for each other. In our experiment, we separated these factors for the first time and examined their impact on a spontaneous conversation. We manipulated the fact that a visual scene was shared or not and the belief that a (...) visual scene was shared or not. Participants watched videos of actors talking about a controversial topic, then discussed their own views while looking at either a blank screen or the actors. Each believed (correctly or not) that their partner was either looking at a blank screen or the same images. We recorded conversants’ eye movements, quantified how they were coordinated, and analyzed their speech patterns. Gaze coordination has been shown to be causally related to the knowledge people share before a conversation, and the information they later recall. Here, we found that both the presence of the visual scene, and beliefs about its presence for another, influenced language use and gaze coordination. (shrink)

We recorded participants' eye movements while they read sentences containing verb‐phrase coordination. Results showed evidence of immediate processing disruption when a reflexive pronoun embedded in the conjoined verb phrase mismatched the sentence subject. We argue that this result is incompatible with models of human parsing that employ only bottom‐up parsing procedures, even when flexible constituency is employed. Models need to incorporate a mechanism similar to the adjoining operation in Tree‐Adjoining Grammar, in which one structure is inserted into another.

Dual task is known to affect postural stabilty in children. We explored the effect of visual tasks on postural control in dyslexic and in age-matched non-dyslexic children. Thirty dyslexic children (mean age: 9.80 ± 0.28 years) were compared with thirty non-dyslexic children (mean age: 9.92 ± 0.35 years). All children underwent ophthalmologic and optometric evaluation. Eye movements were recorded by a video-oculography system (EyeBrain ® T2) and postural sway was recorded simultaneously by a force platform (TechnoConept®). Both groups of children (...) performed fixations, pursuits, pro- and anti-saccades tasks. Dyslexic children showed significantly poor near fusional vergence ranges (convergence and divergence) with respect to the non-dyslexic children. During the postural task, quality of fixation and anti-saccade performance in dyslexic children were significantly worse compared to non-dyslexic children. In contrast, the number of catch-up saccades during pursuits and the latency of pro-and anti-saccades were similar in both groups of children examined. Concerning postural quality, dyslexic children were more unstable than age-matched non-dyslexic children. For both groups of children tested we also observed that executing saccades (pro- and anti-saccades) reduced postural values significantly in comparison with fixation and pursuit tasks. The impairment in convergence and divergence fusional capabilities could be due to an immaturity in cortical structures controlling the vergence system. The poor oculomotor performance reported in dyslexic children suggested a deficit in allocating visual attention and their postural instability observed is in line with the cerebellar impairment previously reported in dyslexic children. Finally, pro- or anti-saccades reduce postural values compared to fixation and pursuit tasks in both groups of children tested, suggesting a different influence of visual tasks on postural control according to their attentional demand. (shrink)

One of the key behavioral effects of attractiveness is increased visual attention to attractive people. This effect is often explained in terms of evolutionary adaptations, such as attractiveness being an indicator of good health. Other factors could influence this effect. In the present study, we explored the modulating role of sexual orientation on the effects of attractiveness on exploratory visual behavior. Heterosexual and homosexual men and women viewed natural-looking scenes that depicted either two women or two men who varied systematically (...) in levels of attractiveness (based on a pre-study). Participants’ eye movements and attractiveness ratings towards the faces of the depicted people were recorded. The results showed that although attractiveness had the largest influence on participants’ behaviors, participants’ sexual orientations strongly modulated the effects. With the exception of homosexual women, all participant groups looked longer and more often at attractive faces that corresponded with their sexual orientations. Interestingly, heterosexual and homosexual men and homosexual women looked longer and more often at the less attractive face of their non-preferred sex than the less attractive face of their preferred sex, evidence that less attractive faces of the preferred sex might have an aversive character. These findings provide evidence for the important role that sexual orientation plays in guiding visual exploratory behavior and evaluations of the attractiveness of others. (shrink)

This study investigates the influence of contrastive stress on the on-line interpretation of ambiguous spoken sentences containing the focus operator only. The pattern of phonological stress was manipulated so as to associate different linguistic expressions with the focus operator only and to invoke different interpretations. Sentences with marked and neutral stress were evaluated relative to visually presented scenes, which depicted a situation consistent with alternative interpretations. Using a head-mounted eye-movement recording system, we measured the processing difficulty associated with (...) phonological stress and subjects’ fixation duration on the various objects in the scenes. Not only was response accuracy superior on sentences with marked stress, as compared to ones with neutral stress, the pattern of fixations revealed earlier resolution of ambiguity in the marked stress condition. The findings suggest that the parser computes multiple interpretations of ambiguous sentences on-line, with marked stress assisting in the rapid resolution of semantic ambiguity. (shrink)

Our brains readily decode facial movements and changes in social attention, reflected in earlier and larger N170 event-related potentials (ERPs) to viewing gaze aversions vs. direct gaze in real faces (Puce et al. 2000). In contrast, gaze aversions in line-drawn faces do not produce these N170 differences (Rossi et al., 2014), suggesting that physical stimulus properties or experimental context may drive these effects. Here we investigated the role of stimulus-induced context on neurophysiological responses to dynamic gaze. Sixteen healthy adults viewed (...) line-drawn and real faces, with dynamic eye aversion and direct gaze transitions, and control stimuli (scrambled arrays and checkerboards) while continuous electroencephalographic (EEG) activity was recorded. EEG data from 2 temporo-occipital clusters of 9 electrodes in each hemisphere where N170 activity is known to be maximal were selected for analysis. N170 peak amplitude and latency, and temporal dynamics from event-related spectral perturbations (ERSPs) were measured in 16 healthy subjects. Real faces generated larger N170s for averted vs. direct gaze motion, however, N170s to real and direct gaze were as large as those to respective controls. N170 amplitude did not differ across line-drawn gaze changes. Overall, bilateral mean gamma power changes for faces relative to control stimuli occurred between 150-350 ms, potentially reflecting signal detection of facial motion. Our data indicate that experimental context does not drive N170 differences to viewed gaze changes. Low-level stimulus properties, such as the high sclera/iris contrast change in real eyes likely drive the N170 changes to viewed aversive movements. (shrink)

In previous studies investigating entrainment and person perception, synchronized movements were found to enhance memory for incidental person attributes. Although this effect is robust, including in dance, the process by which it is actuated are less well understood. In this study, two hypotheses are investigated: that enhanced memory for person attributes is the result of (1) increased gaze time between in-tempo dancers, and/or (2) greater attentional focus between in-tempo dancers. To explore these possible mechanisms in the context of observing dance, (...) an eye-tracking study was conducted in which subjects watched videos of pairs of laterally positioned dancers; only one of the dancers was synchronized with the music, the other being asynchronous. The results were consistent with the first hypothesis—music-dance synchrony gives rise to increased visual inspection times. In addition, there was a preference for upper-body fixations over lower-body fixations across both synchronous and asynchronous conditions. A subsequent, single-dancer eye-tracking study investigated fixations across different body regions, including head, torso, legs and feet. Significantly greater dwell times were recorded for head than torso and legs; feet attracted significantly less dwell time than any other body region. Lastly, the study sought to identify dance gestures responsible for torso- and head-directed fixations. Specifically we asked whether there are features in dance that are specially designed to direct an observer’s gaze towards the face—the main “communicative portal” with respect to the transmission of intent, affect and empathy. (shrink)

The article reflects upon the observational practices and methods developed by the early exponents of ethology committed to naturalistic field study and explores how their approaches and techniques influenced a wider field of popular natural-history filmmaking and photography. In doing so, my focus is upon three aspects of ethological field studies: the socio-technical devices used by ethologists to bring birds closer to them, the distinctive observational and representational practices which they forged, and the analogies they used to codify behaviour. This (...) assemblage of elements included hides or screens from which to watch wild birds without disturbing them, optics to extend human vision, pens and paper to sketch and fix patterns of behaviour, watches to record timings, photography to capture action and freeze movement, and illustration and photographs to visualize behaviour. Carried through natural-history networks, the practices, methods and theories of ethologists like Huxley and Tinbergen influenced popular natural-history filmmaking and photography more broadly from the 1940s, driving a behavioural turn in these cultural practices. This popularization of the ‘ethological eye’ was further facilitated by the convergence of socio-technical devices, forms of observation and dramatization in the work of the early exponents of naturalistic field studies of birds and the popular filmmakers. (shrink)

Observers inspected normal, high quality color displays of everyday visual scenes while their eye movements were recorded. A large display change occurred each time an eye blink occurred. Display changes could either involve "Central Interest" or "Marginal Interest" locations, as determined from descriptions obtained from independent judges in a prior pilot experiment. Visual salience, as determined by luminance, color, and position of the Central and Marginal interest changes were equalized. -/- The results obtained were very similar to those obtained in (...) prior experiments showing failure to detect changes occurring simultaneously with saccades, flicker, or “mudsplashes” in the visual scene: Many changes were very hard to detect, and Marginal Interest changes were harder to detect than Central Interest changes. -/- Analysis of eye movements showed, as expected, that the probability of detecting a change depended on the eye’s distance from the change location. However a surprising finding was that both for Central and Marginal Interest changes, evenwhen observers were directly fixating the change locations (within 1 degree),more than 40% of the time they still failed to see the changes. It seems that looking at something does not guarantee you “ see” it. (shrink)

The hypnosis technique is currently used in the medical field and influences directly the patient's state of relaxation, perception of the body and its visual imagination. There is evidence to suggest that hypnosis state may help patients to better achieve the task of motor imagination, which is central in rehabilitation protocols after a stroke. However, the hypnosis technique could also alter the activity in motor cortex. To the best of our knowledge, the impact of hypnosis on the EEG signal during (...) a movement or an imagined movement is poorly investigated. In particular, how event-related desynchronization (ERD) and event-related synchronization (ERS) patterns would be modulated for different motor tasks may provide a better understanding of the potential benefits of hypnosis for stroke rehabilitation. To investigate this purpose, we recorded EEG signals from 23 healthy volunteers who performed real movements and motor imageries in closed eye condition. Our results suggest that the state of hypnosis changes the sensorimotor beta rhythm during the ERD phase but maintains the ERS phase in the mu and beta frequency band suggesting a different activation of the motor cortex in the hypnotized state. (shrink)

Experiments on visually grounded, definite reference production often manipulate simple visual scenes in the form of grids filled with objects, for example, to test how speakers are affected by the number of objects that are visible. Regarding the latter, it was found that speech onset times increase along with domain size, at least when speakers refer to nonsalient target objects that do not pop out of the visual domain. This finding suggests that even in the case of many distractors, speakers (...) perform object‐by‐object scans of the visual scene. The current study investigates whether this systematic processing strategy can be explained by the simplified nature of the scenes that were used, and if different strategies can be identified for photo‐realistic visual scenes. In doing so, we conducted a preregistered experiment that manipulated domain size and saturation; replicated the measures of speech onset times; and recorded eye movements to measure speakers’ viewing strategies more directly. Using controlled photo‐realistic scenes, we find (1) that speech onset times increase linearly as more distractors are present; (2) that larger domains elicit relatively fewer fixation switches back and forth between the target and its distractors, mainly before speech onset; and (3) that speakers fixate the target relatively less often in larger domains, mainly after speech onset. We conclude that careful object‐by‐object scans remain the dominant strategy in our photo‐realistic scenes, to a limited extent combined with low‐level saliency mechanisms. A relevant direction for future research would be to employ less controlled photo‐realistic stimuli that do allow for interpretation based on context. (shrink)

What role does language play during attention allocation in perceiving and remembering events? We recorded adults‟ eye movements as they studied animated motion events for a later recognition task. We compared native speakers of two languages that use different means of expressing motion (Greek and English). In Experiment 1, eye movements revealed that, when event encoding was made difficult by requiring a concurrent task that did not involve language (tapping), participants spent extra time studying what their language treats as the (...) details of the event. This „linguistic encoding‟ effect was eliminated both when event encoding was made easier (no concurrent task) and when the concurrent task required the use of language (counting aloud). In Experiment 2, under conditions of a delayed concurrent task of counting aloud, participants used language covertly just prior to engaging in the additional task. Together, the results indicate that language can be optionally recruited for encoding events, especially under conditions of high cognitive load. Yet, these effects are malleable and flexible and do not appear to shape core biases in event perception and memory. (shrink)

Transparent windows on food packaging can effectively highlight the actual food inside. The present study examined whether food packaging with transparent windows (relative to packaging with food- and non-food graphic windows in the same position and of the same size) has more advantages in capturing consumer attention and determining consumers’ willingness to purchase. In this study, college students were asked to evaluate prepackaged foods presented on a computer screen, and their eye movements were recorded. The results showed salience effects for (...) both packaging with transparent and food-graphic windows, which were also regulated by food category. Both transparent and graphic packaging gained more viewing time than the non-food graphic baseline condition for all the three selected products (i.e., nuts, preserved fruits and instant cereals). However, no significant difference was found between transparent and graphic window conditions. For preserved fruits, time to first fixations was shorter in transparent packaging than other conditions. For nuts, the willingness to purchase was higher in both transparent and graphic conditions than the baseline condition, while the packaging attractiveness played a key role in mediating consumers’ willingness to purchase. The implications for stakeholders and future research directions are discussed. (shrink)

People often make use of a spatial “mental time line” to represent events in time. We investigated whether the eyes follow such a mental time line during online language comprehension of sentences that refer to the past, present, and future. Participants' eye movements were measured on a blank screen while they listened to these sentences. Saccade direction revealed that the future is mapped higher up in space than the past. Moreover, fewer saccades were made when two events are simultaneously taking (...) place at the present moment compared to two events that are happening in different points in time. This is the first evidence that oculomotor correlates reflect mental looking along an abstract invisible time line during online language comprehension about time. Our results support the idea that observing eye movements is likely to “detect” invisible spatial scaffoldings which are involved in cognitively processing abstract meaning, even when the abstract meaning lacks an explicit spatial correlate. Theoretical implications of these findings are discussed. (shrink)

This study investigates how speed of motion is processed in language. In three eye-tracking experiments, participants were presented with visual scenes and spoken sentences describing fast or slow events (e.g., The lion ambled/dashed to the balloon). Results showed that looking time to relevant objects in the visual scene was affected by the speed of verb of the sentence, speaking rate, and configuration of a supporting visual scene. The results provide novel evidence for the mental simulation of speed in language and (...) show that internal dynamic simulations can be played out via eye movements toward a static visual scene. (shrink)

We know that reading involves coordination between textual characteristics and visual attention, but research linking eye movements during reading and comprehension assessed after reading is surprisingly limited, especially for reading long connected texts. We tested two competing possibilities: (a) the weak association hypothesis: Links between eye movements and comprehension are weak and short‐lived, versus (b) the strong association hypothesis: The two are robustly linked, even after a delay. Using a predictive modeling approach, we trained regression models to predict comprehension scores (...) from global eye movement features, using participant‐level cross‐validation to ensure that the models generalize across participants. We used data from three studies in which readers (Ns = 104, 130, 147) answered multiple‐choice comprehension questions ~30 min after reading a 6,500‐word text, or after reading up to eight 1,000‐word texts. The models generated accurate predictions of participants' text comprehension scores (correlations between observed and predicted comprehension: 0.384, 0.362, 0.372, ps <.001), in line with the strong association hypothesis. We found that making more, but shorter fixations, consistently predicted comprehension across all studies. Furthermore, models trained on one study's data could successfully predict comprehension on the others, suggesting generalizability across studies. Collectively, these findings suggest that there is a robust link between eye movements and subsequent comprehension of a long connected text, thereby connecting theories of low‐level eye movements with those of higher order text processing during reading. (shrink)

What are the effects of word-by-word predictability on sentence processing times during the natural reading of a text? Although information complexity metrics such as surprisal and entropy reduction have been useful in addressing this question, these metrics tend to be estimated using computational language models, which require some degree of commitment to a particular theory of language processing. Taking a different approach, this study implemented a large-scale cumulative cloze task to collect word-by-word predictability data for 40 passages and compute surprisal (...) and entropy reduction values in a theory-neutral manner. A separate group of participants read the same texts while their eye movements were recorded. Results showed that increases in surprisal and entropy reduction were both associated with increases in reading times. Furthermore, these effects did not depend on the global difficulty of the text. The findings suggest that surprisal and entropy reduction independently contribute to variation in reading times, as these metrics seem to capture different aspects of lexical predictability. (shrink)

Three studies were conducted to examine the relation of spatial visualization to solving kinematics problems that involved either predicting the two‐dimensional motion of an object, translating from one frame of reference to another, or interpreting kinematics graphs. In Study 1, 60 physics‐naíve students were administered kinematics problems and spatial visualization ability tests. In Study 2, 17 (8 high‐ and 9 low‐spatial ability) additional students completed think‐aloud protocols while they solved the kinematics problems. In Study 3, the eye movements of fifteen (...) (9 high‐ and 6 low‐spatial ability) students were recorded while the students solved kinematics problems. In contrast to high‐spatial students, most low‐spatial students did not combine two motion vectors, were unable to switch frames of reference, and tended to interpret graphs literally. The results of the study suggest an important relationship between spatial visualization ability and solving kinematics problems with multiple spatial parameters. (shrink)