We used Chinese prenominal relative clauses to test the predictions of two competing accounts of sentence comprehension difficulty: the experience-based account of Levy () and the Dependency Locality Theory. Given that in Chinese RCs, a classifier and/or a passive marker BEI can be added to the sentence-initial position, we manipulated the presence/absence of classifiers and the presence/absence of BEI, such that BEI sentences were passivized subject-extracted RCs, and no-BEI sentences were standard object-extracted RCs. We conducted two self-paced reading experiments, using (...) the same critical stimuli but somewhat different filler items. Reading time patterns from both experiments showed facilitative effects of BEI within and beyond RC regions, and delayed facilitative effects of classifiers, suggesting that cues that occur before a clear signal of an upcoming RC can help Chinese comprehenders to anticipate RC structures. The data patterns are not predicted by the DLT, but they are consistent with the predictions of experience-based theories. (shrink)

Cognitive architectures are unified theories of cognition that take the form of computational formalisms. They support computational models that collectively account for large numbers of empirical regularities using small numbers of computational mechanisms. Empirical coverage and parsimony are the most prominent criteria by which architectures are designed and evaluated, but they are not the only ones. This paper considers three additional criteria that have been comparatively undertheorized. (a) Successful architectures possess subjective and intersubjective meaning, making cognition comprehensible to individual cognitive (...) scientists and organizing groups of like-minded cognitive scientists into genuine communities. (b) Successful architectures provide idioms that structure the design and interpretation of computational models. (c) Successful architectures are strange: They make provocative, often disturbing, and ultimately compelling claims about human information processing that demand evaluation. (shrink)

This paper presents a study of the effect of working memory load on the interpretation of pronouns in different discourse contexts: stories with and without a topic shift. We discuss a computational model (in ACT‐R, Anderson, 2007) to explain how referring expressions are acquired and used. On the basis of simulations of this model, it is predicted that WM constraints only affect adults' pronoun resolution in stories with a topic shift, but not in stories without a topic shift. This latter (...) prediction was tested in an experiment. The results of this experiment confirm that WM load reduces adults' sensitivity to discourse cues signaling a topic shift, thus influencing their interpretation of subsequent pronouns. (shrink)

Though we agree with their argument that language is shaped by domain-general learning processes, Christiansen & Chater (C&C) neglect to detail how the development of these processes shapes language change. We discuss a number of examples that show how developmental processes at multiple levels and timescales are critical to understanding the origin of domain-general mechanisms that shape language evolution.

Associations between language and executive functions are well-established but previous work has often focused more on EFs than on language. To further clarify the language–EF relationship, we assessed several aspects of language and EFs in 431 Swedish children aged 4–6, including selective auditory attention which was measured in an event-related potential paradigm. We also investigated potential associations to age, socioeconomic status, bi-/multilingualism, sex and aspects of preschool attendance and quality. Language and EFs correlated weakly to moderately, indicating that relying on (...) measures of vocabulary alone may overestimate the strength of the language–EF relationship. Contrary to predictions, we found no correlations between selective attention and EFs. There were however correlations between morphosyntactic accuracy and selective auditory attention which is in line with previous work and suggests a specific link between morphosyntax and the ability to suppress irrelevant stimuli. In Sweden, socioeconomic differences are rather small and preschool is universally available, but nevertheless, aspects of parental SES predicted children’s performance on all measures. Bi-/multilingual children performed lower on language also when controlling for SES, highlighting the need for interventions to reduce inequalities in educational outcomes already in preschool. A female advantage was found for both language and EFs, whereas preschool attendance and quality were not significantly related to outcome measures. Future work should include longitudinal studies of language and EF development, include children from diverse SES backgrounds and contribute toward a theoretical framework that further clarifies the language–EF relationship. (shrink)

Two experiments used eyetracking during reading to examine the processing of the matrix verb following object and subject relative clauses. The experiments show that the processing of the matrix verb following an object relative is indeed slowed compared to the processing of the same verb following a subject relative. However, this difficulty is entirely eliminated if additional material intervenes between the object gap and the matrix verb. An explanation in terms of spillover processing is ruled out, suggesting that it is (...) the gap-matrix verb sequence that is itself responsible for the difficulty. We consider two accounts of this difficulty, one emphasizing the potential difficulty of rapidly switching between the sentential subject's thematic or syntactic role in the embedded clause and its role in the matrix clause, and one emphasizing the potential difficulty of performing two demanding memory retrievals in rapid succession. The present experiments also closely replicate the previous findings from eyetracking that the noun phrase and the verb within an object relative are both loci of processing difficulty, but that the former induces substantially greater difficulty. (shrink)

This paper presents a study of the effect of working memory load on the interpretation of pronouns in different discourse contexts: stories with and without a topic shift. We discuss a computational model (in ACT-R, Anderson, 2007) to explain how referring expressions are acquired and used. On the basis of simulations of this model, it is predicted that WM constraints only affect adults' pronoun resolution in stories with a topic shift, but not in stories without a topic shift. This latter (...) prediction was tested in an experiment. The results of this experiment confirm that WM load reduces adults' sensitivity to discourse cues signaling a topic shift, thus influencing their interpretation of subsequent pronouns. (shrink)

It has been suggested that external and/or internal limitations paradoxically may lead to superior learning, that is, the concepts of starting small and less is more (Elman, ; Newport, ). In this paper, we explore the type of incremental ordering during training that might help learning, and what mechanism explains this facilitation. We report four artificial grammar learning experiments with human participants. In Experiments 1a and 1b we found a beneficial effect of starting small using two types of simple recursive (...) grammars: right‐branching and center‐embedding, with recursive embedded clauses in fixed positions and fixed length. This effect was replicated in Experiment 2 (N = 100). In Experiment 3 and 4, we used a more complex center‐embedded grammar with recursive loops in variable positions, producing strings of variable length. When participants were presented an incremental ordering of training stimuli, as in natural language, they were better able to generalize their knowledge of simple units to more complex units when the training input “grew” according to structural complexity, compared to when it “grew” according to string length. Overall, the results suggest that starting small confers an advantage for learning complex center‐embedded structures when the input is organized according to structural complexity. (shrink)

Prediction‐based processes appear to play an important role in language. Few studies, however, have sought to test the relationship within individuals between prediction learning and natural language processing. This paper builds upon existing statistical learning work using a novel paradigm for studying the on‐line learning of predictive dependencies. Within this paradigm, a new “prediction task” is introduced that provides a sensitive index of individual differences for developing probabilistic sequential expectations. Across three interrelated experiments, the prediction task and results thereof are (...) used to bridge knowledge of the empirical relation between statistical learning and language within the context of nonadjacency processing. We first chart the trajectory for learning nonadjacencies, documenting individual differences in prediction learning. Subsequent simple recurrent network simulations then closely capture human performance patterns in the new paradigm. Finally, individual differences in prediction performances are shown to strongly correlate with participants’ sentence processing of complex, long‐distance dependencies in natural language. (shrink)

Although a large literature demonstrates that object‐extracted relative clauses (ORCs) are harder to process than subject‐extracted relative clauses (SRCs), there is less agreement regarding where during processing this difficulty emerges, as well as how best to explain these effects. An eye‐tracking study by Staub, Dillon, and Clifton (2017) demonstrated that readers experience more processing difficulty at the matrix verb for ORCs than for SRCs when the matrix verb immediately follows the relative clause (RC), but the difficulty is eliminated if a (...) prepositional phrase (PP) intervenes. A careful examination of Staub et al.’s materials reveals that the types of PPs used in the experiment were a mixture of locative and temporal PPs. This is important in that locative PPs can modify either a noun phrase or a verb phrase (VP), whereas temporal PPs typically modify VPs, resulting in systematic differences in PP attachment across ORCs versus SRCs. In the current eye‐tracking experiment, we systematically manipulated RC type and PP type in the same sentences used by Staub et al. The manipulation of PP type resulted in a crossover pattern at the matrix verb such that there was a trend for reading times to be longer for ORCs than SRCs when the PP was locative, but reading times were longer for SRCs than ORCs when the PP was temporal. These results provide important information regarding the locus of RC‐processing effects and highlight the importance of carefully considering how intervening material might unintentionally alter the structure or the meaning of a sentence. (shrink)

Given that there is referential uncertainty (noise) when learning words, to what extent can forgetting filter some of that noise out, and be an aid to learning? Using a Cross Situational Learning model we find a U-shaped function of errors indicative of a “Goldilocks” zone of forgetting: an optimum store-loss ratio that is neither too aggressive or too weak, but just the right amount to produce better learning outcomes. Forgetting acts as a high-pass filter that actively deletes (part of) the (...) referential ambiguity noise, retains intended referents, and effectively amplifies the signal. The model achieves this performance without incorporating any specific cognitive biases of the type proposed in the constraints and principles account, and without any prescribed developmental changes in the underlying learning mechanism. Instead we interpret the model performance as more of a by-product of exposure to input, where the associative strengths in the lexicon grow as a function of linguistic experience in combination with memory limitations. The result adds a mechanistic explanation for the experimental evidence on spaced learning and, more generally, advocates integrating domain-general aspects of cognition, such as memory, in to the language acquisition process. (shrink)

Natural language is full of patterns that appear to fit with general linguistic rules but are ungrammatical. There has been much debate over how children acquire these “linguistic restrictions,” and whether innate language knowledge is needed. Recently, it has been shown that restrictions in language can be learned asymptotically via probabilistic inference using the minimum description length (MDL) principle. Here, we extend the MDL approach to give a simple and practical methodology for estimating how much linguistic data are required to (...) learn a particular linguistic restriction. Our method provides a new research tool, allowing arguments about natural language learnability to be made explicit and quantified for the first time. We apply this method to a range of classic puzzles in language acquisition. We find some linguistic rules appear easily statistically learnable from language experience only, whereas others appear to require additional learning mechanisms (e.g., additional cues or innate constraints). (shrink)

An important challenge in bilingualism research is to understand the mechanisms underlying sentence processing in a second language and whether they are comparable to those underlying native processing. Here, we focus on verb-particle constructions (VPCs) that are among the most difficult elements to acquire in L2 English. The verb and the particle form a unit, which often has a non-compositional meaning (e.g., look up or chew out), making the combined structure semantically opaque. However, bilinguals with higher levels of English proficiency (...) can develop a good knowledge of the semantic properties of verb-particle constructions (Blais and Gonnerman, 2013). A second difficulty is that in a sentence context, the particle can be shifted after the direct object of the verb, (e.g., The professor looked it up). The processing is more challenging when the object is long (e.g. The professor looked the student’s last name up.). This shifted structure favors syntactic processing at the expense of VPC semantic processing. We sought to determine whether or not bilinguals’ reading time (RT) patterns would be similar to those observed for native monolinguals (Gonnerman and Hayes, 2005) when reading VPCs in sentential contexts. French-English bilinguals were tested for English language proficiency, working memory and explicit VPC semantic knowledge. During a self-paced reading task, participants read 78 sentences with verb-particle constructions that varied according to parameters that influence native speakers’ reading dynamics: verb-particle transparency, particle adjacency and length of the object noun phrase (NP; 2, 3, or 5 words). RTs in a critical region that included verbs, NPs and particles were measured. Results revealed that RTs were modulated by participants’ English proficiency, with higher proficiency associated with shorter RTs. Examining participants’ explicit semantic knowledge of VPCs and working memory, only readers with more native-like knowledge of VPCs and a high working memory presented RT patterns that were similar to those of monolinguals. Therefore, given the necessary lexical and computational resources, bilingual processing of novel structures at the syntax-semantics interface follows the principles influencing native processing. The findings are in keeping with theories that postulate similar representations and processing in L1 and L2 modulated by processing difficulty. (shrink)

All other things being equal the parser favors attaching an ambiguous modifier to the most recent possible site. A plausible explanation is that locality preferences such as this arise in the service of minimizing memory costs—more distant sentential material is more difficult to reactivate than more recent material. Note that processing any sentence requires linking each new lexical item with material in the current parse. This often involves the construction of long‐distance dependencies. Under a resource‐limited view of language processing, lengthy (...) integrations should induce difficulty even in unambiguous sentences. To date there has been little direct quantitative evidence in support of this perspective. This article presents 2 self‐paced reading studies, which explore the hypothesis that dependency distance is a fundamental determinant of reading complexity in unambiguous constructions in English. The evidence suggests that the difficulty associated with integrating a new input item is heavily determined by the amount of lexical material intervening between the input item and the site of its target dependents. The patterns observed here are not straightforwardly accounted for within purely experience‐based models of complexity. Instead, this work supports the role of a memory bottleneck in language comprehension. This constraint arises because hierarchical linguistic relations must be recovered from a linear input stream. (shrink)

An English double-embedded relative clause from which the middle verb is omitted can often be processed more easily than its grammatical counterpart, a phenomenon known as the grammaticality illusion. This effect has been found to be reversed in German, suggesting that the illusion is language specific rather than a consequence of universal working memory constraints. We present results from three self-paced reading experiments which show that Dutch native speakers also do not show the grammaticality illusion in Dutch, whereas both German (...) and Dutch native speakers do show the illusion when reading English sentences. These findings provide evidence against working memory constraints as an explanation for the observed effect in English. We propose an alternative account based on the statistical patterns of the languages involved. In support of this alternative, a single recurrent neural network model that is trained on both Dutch and English sentences is shown to predict the cross-linguistic difference in the grammaticality effect. (shrink)

We explore the interaction between oculomotor control and language comprehension on the sentence level using two well-tested computational accounts of parsing difficulty. Previous work (Boston, Hale, Vasishth, & Kliegl, 2011) has shown that surprisal (Hale, 2001; Levy, 2008) and cue-based memory retrieval (Lewis & Vasishth, 2005) are significant and complementary predictors of reading time in an eyetracking corpus. It remains an open question how the sentence processor interacts with oculomotor control. Using a simple linking hypothesis proposed in Reichle, Warren, and (...) McConnell (2009), we integrated both measures with the eye movement model EMMA (Salvucci, 2001) inside the cognitive architecture ACT-R (Anderson et al., 2004). We built a reading model that could initiate short “Time Out regressions” (Mitchell, Shen, Green, & Hodgson, 2008) that compensate for slow postlexical processing. This simple interaction enabled the model to predict the re-reading of words based on parsing difficulty. The model was evaluated in different configurations on the prediction of frequency effects on the Potsdam Sentence Corpus. The extension of EMMA with postlexical processing improved its predictions and reproduced re-reading rates and durations with a reasonable fit to the data. This demonstration, based on simple and independently motivated assumptions, serves as a foundational step toward a precise investigation of the interaction between high-level language processing and eye movement control. (shrink)

An essential aspect of knowing language is knowing the words of that language. This knowledge is usually thought to reside in the mental lexicon, a kind of dictionary that contains information regarding a word’s meaning, pronunciation, syntactic characteristics, and so on. In this article, a very different view is presented. In this view, words are understood as stimuli that operate directly on mental states. The phonological, syntactic and semantic properties of a word are revealed by the effects it has on (...) those states. (shrink)

Memory is fleeting. New material rapidly obliterates previous material. How, then, can the brain deal successfully with the continual deluge of linguistic input? We argue that, to deal with this “Now-or-Never” bottleneck, the brain must compress and recode linguistic input as rapidly as possible. This observation has strong implications for the nature of language processing: (1) the language system must “eagerly” recode and compress linguistic input; (2) as the bottleneck recurs at each new representational level, the language system must build (...) a multilevel linguistic representation; and (3) the language system must deploy all available information predictively to ensure that local linguistic ambiguities are dealt with “Right-First-Time”; once the original input is lost, there is no way for the language system to recover. This is “Chunk-and-Pass” processing. Similarly, language learning must also occur in the here and now, which implies that language acquisition is learning to process, rather than inducing, a grammar. Moreover, this perspective provides a cognitive foundation for grammaticalization and other aspects of language change. Chunk-and-Pass processing also helps explain a variety of core properties of language, including its multilevel representational structure and duality of patterning. This approach promises to create a direct relationship between psycholinguistics and linguistic theory. More generally, we outline a framework within which to integrate often disconnected inquiries into language processing, language acquisition, and language change and evolution. (shrink)

In the generative tradition, the language faculty has been shrinking—perhaps to include only the mechanism of recursion. This paper argues that even this view of the language faculty is too expansive. We first argue that a language faculty is difficult to reconcile with evolutionary considerations. We then focus on recursion as a detailed case study, arguing that our ability to process recursive structure does not rely on recursion as a property of the grammar, but instead emerge gradually by piggybacking on (...) domain-general sequence learning abilities. Evidence from genetics, comparative work on non-human primates, and cognitive neuroscience suggests that humans have evolved complex sequence learning skills, which were subsequently pressed into service to accommodate language. Constraints on sequence learning therefore have played an important role in shaping the cultural evolution of linguistic structure, including our limited abilities for processing recursive structure. Finally, we re-evaluate some of the key considerations that have often been taken to require the postulation of a language faculty. (shrink)

It is widely assumed that human learning and the structure of human languages are intimately related. This relationship is frequently suggested to derive from a language-specific biological endowment, which encodes universal, but communicatively arbitrary, principles of language structure (a Universal Grammar or UG). How might such a UG have evolved? We argue that UG could not have arisen either by biological adaptation or non-adaptationist genetic processes, resulting in a logical problem of language evolution. Specifically, as the processes of language change (...) are much more rapid than processes of genetic change, language constitutes a both over time and across different human populations, and, hence, cannot provide a stable environment to which language genes could have adapted. We conclude that a biologically determined UG is not evolutionarily viable. Instead, the original motivation for UG arises because language has been shaped to fit the human brain, rather than vice versa. Following Darwin, we view language itself as a complex and interdependent which evolves under selectional pressures from human learning and processing mechanisms. That is, languages themselves are shaped by severe selectional pressure from each generation of language users and learners. This suggests that apparently arbitrary aspects of linguistic structure may result from general learning and processing biases deriving from the structure of thought processes, perceptuo-motor factors, cognitive limitations, and pragmatics. (shrink)

Our target article argued that a genetically specified Universal Grammar (UG), capturing arbitrary properties of languages, is not tenable on evolutionary grounds, and that the close fit between language and language learners arises because language is shaped by the brain, rather than the reverse. Few commentaries defend a genetically specified UG. Some commentators argue that we underestimate the importance of processes of cultural transmission; some propose additional cognitive and brain mechanisms that may constrain language and perhaps differentiate humans from nonhuman (...) primates; and others argue that we overstate or understate the case against co-evolution of language genes. In engaging with these issues, we suggest that a new synthesis concerning the relationship between brains, genes, and language may be emerging. (shrink)

If human language must be squeezed through a narrow cognitive bottleneck, what are the implications for language processing, acquisition, change, and structure? In our target article, we suggested that the implications are far-reaching and form the basis of an integrated account of many apparently unconnected aspects of language and language processing, as well as suggesting revision of many existing theoretical accounts. With some exceptions, commentators were generally supportive both of the existence of the bottleneck and its potential implications. Many commentators (...) suggested additional theoretical and linguistic nuances and extensions, links with prior work, and relevant computational and neuroscientific considerations; some argued for related but distinct viewpoints; a few, though, felt traditional perspectives were being abandoned too readily. Our response attempts to build on the many suggestions raised by the commentators and to engage constructively with challenges to our approach. (shrink)