Topics in Cognitive Science 5 (3):452-474 (2013)
AbstractWe explore the interaction between oculomotor control and language comprehension on the sentence level using two well-tested computational accounts of parsing difficulty. Previous work (Boston, Hale, Vasishth, & Kliegl, 2011) has shown that surprisal (Hale, 2001; Levy, 2008) and cue-based memory retrieval (Lewis & Vasishth, 2005) are significant and complementary predictors of reading time in an eyetracking corpus. It remains an open question how the sentence processor interacts with oculomotor control. Using a simple linking hypothesis proposed in Reichle, Warren, and McConnell (2009), we integrated both measures with the eye movement model EMMA (Salvucci, 2001) inside the cognitive architecture ACT-R (Anderson et al., 2004). We built a reading model that could initiate short “Time Out regressions” (Mitchell, Shen, Green, & Hodgson, 2008) that compensate for slow postlexical processing. This simple interaction enabled the model to predict the re-reading of words based on parsing difficulty. The model was evaluated in different configurations on the prediction of frequency effects on the Potsdam Sentence Corpus. The extension of EMMA with postlexical processing improved its predictions and reproduced re-reading rates and durations with a reasonable fit to the data. This demonstration, based on simple and independently motivated assumptions, serves as a foundational step toward a precise investigation of the interaction between high-level language processing and eye movement control
Similar books and articles
The e-z reader model of eye-movement control in reading: Comparisons to other models.Erik D. Reichle, Keith Rayner & Alexander Pollatsek - 2003 - Behavioral and Brain Sciences 26 (4):445-476.
Visual word recognition and oculomotor control in reading.Lynn Huestegge, Jonathan Grainger & Ralph Radach - 2003 - Behavioral and Brain Sciences 26 (4):487-488.
Uncertainty Reduction as a Measure of Cognitive Load in Sentence Comprehension.Stefan L. Frank - 2013 - Topics in Cognitive Science 5 (3):475-494.
E-z reader 7 provides a platform for explaining how low- and high-level linguistic processes influence eye movements.Gary E. Raney - 2003 - Behavioral and Brain Sciences 26 (4):498-499.
Probabilistic Modeling of Discourse‐Aware Sentence Processing.Amit Dubey, Frank Keller & Patrick Sturt - 2013 - Topics in Cognitive Science 5 (3):425-451.
The game of word skipping: Who are the competitors?Ralf Engbert & Reinhold Kliegl - 2003 - Behavioral and Brain Sciences 26 (4):481-482.
Direct Evidence of Memory Retrieval as a Source of Difficulty in Non-Local Dependencies in Language.Evelina Fedorenko, Rebecca Woodbury & Edward Gibson - 2013 - Cognitive Science 37 (2):378-394.
Attention, saccade programming, and the timing of eye-movement control.Ralph Radach, Heiner Deubel & Dieter Heller - 2003 - Behavioral and Brain Sciences 26 (4):497-498.
Eye-movement control in reading: Models and predictions.Eyal M. Reingold - 2003 - Behavioral and Brain Sciences 26 (4):500-501.
Methodologies for comparing complex computational models of eye-movement control in reading: Just fitting the data is not enough.Ronan Reilly & Ralph Radach - 2003 - Behavioral and Brain Sciences 26 (4):499-500.
Eye movements in reading: Models and data.Keith Rayner, Alexander Pollatsek & Erik D. Reichle - 2003 - Behavioral and Brain Sciences 26 (4):507-518.
Unconscious processing embedded in conscious processing: Evidence from gaze time on chinese sentence reading.Yung-Chi Sung & Da-Lun Tang - 2007 - Consciousness and Cognition 16 (2):339-348.
Basic assumptions concerning eye-movement control during reading.George W. McConkie & Shun-Nan Yang - 2003 - Behavioral and Brain Sciences 26 (4):493-494.
Casimir: An Architecture for Mental Spatial Knowledge Processing.Holger Schultheis & Thomas Barkowsky - 2011 - Topics in Cognitive Science 3 (4):778-795.
Impulse Processing: A Dynamical Systems Model of Incremental Eye Movements in the Visual World Paradigm.Anuenue Kukona & Whitney Tabor - 2011 - Cognitive Science 35 (6):1009-1051.
Added to PP
Historical graph of downloads
Citations of this work
Exploratory and Confirmatory Analyses in Sentence Processing: A Case Study of Number Interference in German.Bruno Nicenboim, Shravan Vasishth, Felix Engelmann & Katja Suckow - 2018 - Cognitive Science 42 (S4):1075-1100.
The Effect of Prominence and Cue Association on Retrieval Processes: A Computational Account.Felix Engelmann, Lena A. Jӓger & Shravan Vasishth - 2019 - Cognitive Science 43 (12).
A Computational Investigation of Sources of Variability in Sentence Comprehension Difficulty in Aphasia.Paul Mätzig, Shravan Vasishth, Felix Engelmann, David Caplan & Frank Burchert - 2018 - Topics in Cognitive Science 10 (1):161-174.
A Computational Evaluation of Sentence Processing Deficits in Aphasia.Umesh Patil, Sandra Hanne, Frank Burchert, Ria De Bleser & Shravan Vasishth - 2016 - Cognitive Science 40 (1):5-50.
Building an ACT‐R Reader for Eye‐Tracking Corpus Data.Jakub Dotlačil - 2018 - Topics in Cognitive Science 10 (1):144-160.
References found in this work
A theory of reading: From eye fixations to comprehension.Marcel A. Just & Patricia A. Carpenter - 1980 - Psychological Review 87 (4):329-354.
An Integrated Theory of the Mind.John R. Anderson, Daniel Bothell, Michael D. Byrne, Scott Douglass, Christian Lebiere & Yulin Qin - 2004 - Psychological Review 111 (4):1036-1060.
A capacity theory of comprehension: Individual differences in working memory.Marcel A. Just & Patricia A. Carpenter - 1992 - Psychological Review 99 (1):122-149.
An activation‐based model of sentence processing as skilled memory retrieval.Richard L. Lewis & Shravan Vasishth - 2005 - Cognitive Science 29 (3):375-419.