In the 1950s, Noam Chomsky offered a new vision for linguistic research and syntacticians. This chapter explores some ways in which Chomsky's linguistic work has influenced research on one domain of linguistic performance, sentence processing, over the last half century. It shows that Chomsky's claim in Aspects of the Theory of Syntax is largely borne out: "the study of performance will proceed only as far as the study of the underlying competence permits". The chapter briefly addresses a question (...) about the scope of modern sentence processing research and its relationship to specific grammatical formalisms. It reviews the literature on incremental ambiguity resolution, moves to the processing of long‐distance filler‐gap dependency processing, and provides information on the processing of anaphoric relations. In order to illustrate how the phenomenon has contributed to psycholinguistic theorizing, the chapter outlines a well‐known model and then considers how other models diverge. (shrink)

Three online mouse cursor-tracking experiments investigated predictive sentence processing at speed. Participants viewed visual arrays with objects like a bike and kite while hearing predictive sentences like, “What the man will ride, which is shown on this page, is the bike,” or non-predictive sentences like, “What the man will spot, which is shown on this page, is the bike.” Based on the selectional restrictions of “ride” (i.e., vs. “spot”), participants made mouse cursor movements to the bike before hearing (...) the noun “bike.” Compellingly, this effect was observed at speech rates of ∼3 (Experiment 1), ∼6 (Experiment 2), and ∼9 (Experiment 3) syllables/s. While prior research suggests striking limits on prediction, these results highlight temporal dynamics that may impact comprehenders’ ability to preactivate information when hearing impressively rapid speech. Implications for theories of sentence processing are discussed. (shrink)

There is now considerable evidence that human sentence processing is expectation based: As people read a sentence, they use their statistical experience with their language to generate predictions about upcoming syntactic structure. This study examines how sentence processing is affected by readers' uncertainty about those expectations. In a self-paced reading study, we use lexical subcategorization distributions to factorially manipulate both the strength of expectations and the uncertainty about them. We compare two types of uncertainty: uncertainty (...) about the verb's complement, reflecting the next prediction step; and uncertainty about the full sentence, reflecting an unbounded number of prediction steps. We find that uncertainty about the full structure, but not about the next step, was a significant predictor of processing difficulty: Greater reduction in uncertainty was correlated with increased reading times. We additionally replicated previously observed effects of expectation violation, orthogonal to the effect of uncertainty. This suggests that both surprisal and uncertainty affect human RTs. We discuss the consequences for theories of sentence comprehension. (shrink)

Grodzinsky's theory of agrammatic sentence processing fails to account for crucial empirical facts. In contrast to his predictions, the data show that there are (1) degrees of severity and (2) problems with sentences that do not require movement, and that (3) under the right task circumstances, full-fledged syntactic trees are constructed.

Resumen Se estudia comparativamente el desempeño de adultos mayores y de adultos jóvenes en una tarea concurrente que consiste en leer oraciones ecuacionales mientras, al mismo tiempo, se retienen en la memoria tres palabras. El propósito del experimento es averiguar si existe un efecto de las variables edad, memoria operativa, complejidad sintáctica e interferencia de una carga concurrente de memoria en el procesamiento y comprensión de oraciones de sintaxis compleja. El análisis estadístico multinivel realizado revela que tanto el procesamiento en (...) línea de las oraciones ecuacionales como su comprensión se ven afectados significativamente por la edad de los participantes cuando opera una carga de memoria concurrente. Las variables memoria operativa y complejidad sintáctica, por su parte, afectan también significativamente el desempeño de los sujetos, pero independientemente de su edad.The performance of older and young adults in a concurrent task -to read equational sentences while at the same time the subjects retain in memory three words- is comparatively studied. The purpose of the experiment is to find out if there is an effect of the variables of age, working memory, syntactic complexity and interference of a concurrent memory load processing on the comprehension of syntactically complex sentences. The multilevel statistical analysis reveals that both online processing of cleft sentences as their understanding is significantly affected by the age of participants when operating a concurrent memory load. The working memory variables and syntactical complexity, meanwhile, also significantly affect the performance of subjects, but regardless of age. (shrink)

Individuals with agrammatic Broca's aphasia experience difficulty when processing reversible non-canonical sentences. Different accounts have been proposed to explain this phenomenon. The Trace Deletion account attributes this deficit to an impairment in syntactic representations, whereas others propose that the underlying structural representations are unimpaired, but sentence comprehension is affected by processing deficits, such as slow lexical activation, reduction in memory resources, slowed processing and/or intermittent deficiency, among others. We test the claims of two processing accounts, (...) slowed processing and intermittent deficiency, and two versions of the Trace Deletion Hypothesis, in a computational framework for sentence processing implemented in ACT-R. The assumption of slowed processing is operationalized as slow procedural memory, so that each processing action is performed slower than normal, and intermittent deficiency as extra noise in the procedural memory, so that the parsing steps are more noisy than normal. We operationalize the TDH as an absence of trace information in the parse tree. To test the predictions of the models implementing these theories, we use the data from a German sentence—picture matching study reported in Hanne, Sekerina, Vasishth, Burchert, and De Bleser. The data consist of offline and online measures. From among the models considered, the model assuming that both slowed processing and intermittent deficiency are present emerges as the best model of sentence processing difficulty in aphasia. The modeling of individual differences suggests that, if we assume that patients have both slowed processing and intermittent deficiency, they have them in differing degrees. (shrink)

Object relative clauses are harder to process than subject relative clauses. Under Grillo’s Generalized Minimality framework, complexity effects of object relatives are construed as intervention effects, which result from an interaction between locality constraints on movement and the sentence processing system. Specifically, intervention of the subject DP in the movement dependency is expected to generate a minimality violation whenever processing limitations render the moved object underspecified, resulting in compromised comprehension. In the present study, assuming Generalized Minimality, we (...) compared the processing of object relatives with the processing of subject control in ditransitives, which, like object relatives, instantiates a syntactic dependency across an intervening DP. This comparison is justified by the current debate on whether Control should be analyzed as movement: if control involves movement of the controller DP, as proposed by Hornstein, a parallel between the processing of object relatives and subject control in ditransitives may be anticipated on the basis of intervention. In addition, we explored whether general cognitive factors contribute to complexity effects ascribed to movement across a DP. Sixty-nine adult speakers of European Portuguese read sentences and answered comprehension probes in a self-paced reading task with moving-window display, comprising four experimental conditions: Subject Relatives; Object Relatives; Subject Control; Object Control. Furthermore, participants performed four supplementary tasks, serving as measures of resistance to interference, lexical knowledge, working memory capacity and lexical access ability. The results from the reading task showed that whereas object relatives were harder to process than subject relatives, subject control was not harder to process than object control, arguing against recent movement accounts of control. Furthermore, we found that whereas object relative complexity effects assessed by response times to comprehension probes interacted with Reading Span, object relative complexity effects assessed by comprehension accuracy and reading times did not interact with any of the supplementary tasks. We discuss these results in light of Generalized Minimality and the hypothesis of modularity in syntactic processing. (shrink)

A key component of research on human sentence processing is to characterize the processing difficulty associated with the comprehension of words in context. Models that explain and predict this difficulty can be broadly divided into two kinds, expectation‐based and memory‐based. In this work, we present a new model of incremental sentence processing difficulty that unifies and extends key features of both kinds of models. Our model, lossy‐context surprisal, holds that the processing difficulty at a (...) word in context is proportional to the surprisal of the word given a lossy memory representation of the context—that is, a memory representation that does not contain complete information about previous words. We show that this model provides an intuitive explanation for an outstanding puzzle involving interactions of memory and expectations: language‐dependent structural forgetting, where the effects of memory on sentence processing appear to be moderated by language statistics. Furthermore, we demonstrate that dependency locality effects, a signature prediction of memory‐based theories, can be derived from lossy‐context surprisal as a special case of a novel, more general principle called information locality. (shrink)

Given the replication crisis in cognitive science, it is important to consider what researchers need to do in order to report results that are reliable. We consider three changes in current practice that have the potential to deliver more realistic and robust claims. First, the planned experiment should be divided into two stages, an exploratory stage and a confirmatory stage. This clear separation allows the researcher to check whether any results found in the exploratory stage are robust. The second change (...) is to carry out adequately powered studies. We show that this is imperative if we want to obtain realistic estimates of effects in psycholinguistics. The third change is to use Bayesian data-analytic methods rather than frequentist ones; the Bayesian framework allows us to focus on the best estimates we can obtain of the effect, rather than rejecting a strawman null. As a case study, we investigate number interference effects in German. Number feature interference is predicted by cue-based retrieval models of sentence processing, but it has shown inconsistent results. We show that by implementing the three changes mentioned, suggestive evidence emerges that is consistent with the predicted number interference effects. (shrink)

Human attention is limited in its capacity and duration. In language, this is manifested in many ways, but more conspicuously in the strategies by which information is distributed in utterances, that is, their information structures. We contend that the pragmatic categories of Topic and Presupposition precisely meet the necessity to modulate attentional resources on sentence contents, and they do this by “directing” certain contents to automatic and others to controlled processing mechanisms. We discuss experimental findings suggesting that presupposed (...) or topicalized information correlates with automatic processing, and we suggest that this association grounded for the emergence of topic and presupposition units in human communication. We also put forth the processing automaticity induced by these units as the rationale behind their persuasiveness in some specific contexts of language use. (shrink)

We identify a number of principles with respect to prediction that, we argue, underpin adult language comprehension: (a) comprehension consists in realizing a mapping between the unfolding sentence and the event representation corresponding to the real‐world event being described; (b) the realization of this mapping manifests as the ability to predict both how the language will unfold, and how the real‐world event would unfold if it were being experienced directly; (c) concurrent linguistic and nonlinguistic inputs, and the prior internal (...) states of the system, each drive the predictive process; (d) the representation of prior internal states across a representational substrate common to the linguistic and nonlinguistic domains enables the predictive process to operate over variable time frames and variable levels of representational abstraction. We review empirical data exemplifying the operation of these principles and discuss the relationship between prediction, event structure, thematic role assignment, and incrementality. (shrink)

The native language changes as a result of contact with a second language, and the pattern and degree of such change depend on a variety of factors like the bilingual experience or the linguistic level. Here, we present a systematic review and meta-analysis of works that explore variations in native sentence comprehension and production by comparing monolinguals and bilinguals. Fourteen studies in the meta-analysis provided information regarding the bilingual experience and differences at the morphosyntactic level using behavioral methods. Overall, (...) we observed that first language processing is subject to small transformations in bilinguals that occur in sentence comprehension and production. The magnitude of the changes depended on bilingual experiences, but only length of residence in an L2 setting predicted the degree of change, where shorter length of residence was associated with larger changes. Results are discussed and related to the cognitive processes that potentially cause the transformations in the first language. The present work reveals some limitations in the field that should be addressed in future studies to better understand the mechanisms behind language attrition. (shrink)

Experimental research shows that human sentence processing uses information from different levels of linguistic analysis, for example, lexical and syntactic preferences as well as semantic plausibility. Existing computational models of human sentence processing, however, have focused primarily on lexico‐syntactic factors. Those models that do account for semantic plausibility effects lack a general model of human plausibility intuitions at the sentence level. Within a probabilistic framework, we propose a wide‐coverage model that both assigns thematic roles to (...) verb–argument pairs and determines a preferred interpretation by evaluating the plausibility of the resulting (verb, role, argument) triples. The model is trained on a corpus of role‐annotated language data. We also present a transparent integration of the semantic model with an incremental probabilistic parser. We demonstrate that both the semantic plausibility model and the combined syntax/semantics model predict judgment and reading time data from the experimental literature. (shrink)

Can sentence comprehension impairments in aphasia be explained by difficulties arising from dependency completion processes in parsing? Two distinct models of dependency completion difficulty are investigated, the Lewis and Vasishth (2005) activation-based model and the direct-access model (DA; McElree, 2000). These models' predictive performance is compared using data from individuals with aphasia (IWAs) and control participants. The data are from a self-paced listening task involving subject and object relative clauses. The relative predictive performance of the models is evaluated using (...) k-fold cross-validation. For both IWAs and controls, the activation-based model furnishes a somewhat better quantitative fit to the data than the DA. Model comparisons using Bayes factors show that, assuming an activation-based model, intermittent deficiencies may be the best explanation for the cause of impairments in IWAs, although slowed syntax and lexical delayed access may also play a role. This is the first computational evaluation of different models of dependency completion using data from impaired and unimpaired individuals. This evaluation develops a systematic approach that can be used to quantitatively compare the predictions of competing models of language processing. (shrink)

Can sentence comprehension impairments in aphasia be explained by difficulties arising from dependency completion processes in parsing? Two distinct models of dependency completion difficulty are investigated, the Lewis and Vasishth (2005) activation‐based model and the direct‐access model (DA; McElree, 2000). These models' predictive performance is compared using data from individuals with aphasia (IWAs) and control participants. The data are from a self‐paced listening task involving subject and object relative clauses. The relative predictive performance of the models is evaluated using (...) k‐fold cross‐validation. For both IWAs and controls, the activation‐based model furnishes a somewhat better quantitative fit to the data than the DA. Model comparisons using Bayes factors show that, assuming an activation‐based model, intermittent deficiencies may be the best explanation for the cause of impairments in IWAs, although slowed syntax and lexical delayed access may also play a role. This is the first computational evaluation of different models of dependency completion using data from impaired and unimpaired individuals. This evaluation develops a systematic approach that can be used to quantitatively compare the predictions of competing models of language processing. (shrink)

Probabilistic models of sentence comprehension are increasingly relevant to questions concerning human language processing. However, such models are often limited to syntactic factors. This restriction is unrealistic in light of experimental results suggesting interactions between syntax and other forms of linguistic information in human sentence processing. To address this limitation, this article introduces two sentence processing models that augment a syntactic component with information about discourse co-reference. The novel combination of probabilistic syntactic components with (...) co-reference classifiers permits them to more closely mimic human behavior than existing models. The first model uses a deep model of linguistics, based in part on probabilistic logic, allowing it to make qualitative predictions on experimental data; the second model uses shallow processing to make quantitative predictions on a broad-coverage reading-time corpus. (shrink)

Children and adults use established global knowledge to generate real‐time linguistic predictions, but less is known about how listeners generate predictions in circumstances that semantically conflict with long‐standing event knowledge. We explore these issues in adults and 5‐ to 10‐year‐old children using an eye‐tracked sentence comprehension task that tests real‐time activation of unexpected events that had been previously encountered in brief stories. Adults generated predictions for these previously unexpected events based on these discourse cues alone, whereas children overall did (...) not override their established global knowledge to generate expectations for semantically conflicting material; however, they do show an increased ability to integrate discourse cues to generate appropriate predictions for sentential endings. These results indicate that the ability to rapidly integrate and deploy semantically conflicting knowledge has a long developmental trajectory, with adult‐like patterns not emerging until later in childhood. (shrink)

Name der Zeitschrift: Language and Cognition - An Interdisciplinary Journal of Language and Cognitive Science Jahrgang: 5 Heft: 4 Seiten: 345-373.

Among theories of human language comprehension, cue‐based memory retrieval has proven to be a useful framework for understanding when and how processing difficulty arises in the resolution of long‐distance dependencies. Most previous work in this area has assumed that very general retrieval cues like [+subject] or [+singular] do the work of identifying (and sometimes misidentifying) a retrieval target in order to establish a dependency between words. However, recent work suggests that general, handpicked retrieval cues like these may not be (...) enough to explain illusions of plausibility (Cunnings & Sturt, 2018), which can arise in sentences like The letter next to the porcelain plate shattered. Capturing such retrieval interference effects requires lexically specific features and retrieval cues, but handpicking the features is hard to do in a principled way and greatly increases modeler degrees of freedom. To remedy this, we use well‐established word embedding methods for creating distributed lexical feature representations that encode information relevant for retrieval using distributed retrieval cue vectors. We show that the similarity between the feature and cue vectors (a measure of plausibility) predicts total reading times in Cunnings and Sturt’s eye‐tracking data. The features can easily be plugged into existing parsing models (including cue‐based retrieval and self‐organized parsing), putting very different models on more equal footing and facilitating future quantitative comparisons. (shrink)

The sentence is a fundamental unit of language (Ferreira & Çokal, 2015). Comprehending a sentence lies in extracting its meaning, which is closely related to its syntactic structure. One sentence m...

Sentence comprehension - the way we process and understand spoken and written language - is a central and important area of research within psycholinguistics. This book explores the contribution of computational linguistics to the field, showing how computational models of sentence processing can help scientists in their investigation of human cognitive processes. It presents the leading computational model of retrieval processes in sentence processing, the Lewis and Vasishth cue-based retrieval mode, and develops a principled methodology (...) for parameter estimation and model comparison/evaluation using benchmark data, to enable researchers to test their own models of retrieval against the present model. It also provides readers with an overview of the last 20 years of research on the topic of retrieval processes in sentence comprehension, along with source code that allows researchers to extend the model and carry out new research. Comprehensive in its scope, this book is essential reading for researchers in cognitive science. (shrink)

Name der Zeitschrift: Cognitive Linguistics Jahrgang: 25 Heft: 4 Seiten: 617-653.