This paper presents a study of the effect of working memory load on the interpretation of pronouns in different discourse contexts: stories with and without a topic shift. We discuss a computational model (in ACT‐R, Anderson, 2007) to explain how referring expressions are acquired and used. On the basis of simulations of this model, it is predicted that WM constraints only affect adults' pronoun resolution in stories with a topic shift, but not in stories without a topic shift. This latter (...) prediction was tested in an experiment. The results of this experiment confirm that WM load reduces adults' sensitivity to discourse cues signaling a topic shift, thus influencing their interpretation of subsequent pronouns. (shrink)

The Ouroboros Model proposes a brain inspired cognitive architecture including detailed suggestions for the main processing steps in an overall conceptualization of cognition as embodied and embedded computing. All memories are structured into schemata, which are firmly grounded in the body of an actor. A cyclic and iterative data-acquisition and -processing loop forms the backbone of all cognitive activity. Ever more sophisticated schemata are built up incrementally from the wide combination of neural activity, concurrent at the point in time when (...) the memory is established; i.e., distinct representations are accrued. Later on, an entire schema can be reinstated from diverse subsets of its constituent features. In order to decode or compile ever more elaborate constructions, extant building blocks are concatenated. They are serially linked via common or “connection-attributes” of different representations and symbols, and they are employed for serial perception, processing and action, in particular, also for language production. At various levels, commonalities between different schemata lead to a similar preferred use of their respective tokens and subsequently shared categorizations. Rules, for the concatenation of words, akin to the ones governing chemical reactions, can be abstracted. As special kinds of symbols, words and word-classes along with the whole grammar of a language can thus be seen as a direct consequence of the processes outlined in the Ouroboros Model. Strong emphasis is put on the dimension of time over short intervals during active experience and performance, and, in particular, during interactions with other agents. (shrink)

Main clause phenomena (MCPs) are syntactic constructions that occur predominantly or exclusively in main clauses. I propose a processing explanation for MCPs. Sentence processing is easiest at the beginning of the sentence (requiring less search); this follows naturally from widely held assumptions about sentence processing. Because of this, a wider variety of constructions can be allowed at the beginning of the sentence without overwhelming the sentence‐processing mechanism. Unlike pragmatic and grammatical accounts of MCPs, the processing account predicts avoidance of MCPs (...) in non‐initial main clauses (non‐initial coordinate clauses and premodified clauses). A corpus study supports these predictions, but it is somewhat inconclusive. A further corpus study examines another type of syntactic construction, premodifying adjunct phrases (“openers”); the prediction here is that less common types of opener will be especially avoided in non‐initial contexts. The prediction is confirmed, supporting the processing view of rare constructions. (shrink)

In noun phrase coordinate constructions, there is a strong tendency for the syntactic structure of the second conjunct to match that of the first; the second conjunct in such constructions is therefore low in syntactic information. The theory of uniform information density predicts that low-information syntactic constructions will be counterbalanced by high information in other aspects of that part of the sentence, and high-information constructions will be counterbalanced by other low-information components. Three predictions follow: lexical probabilities will be lower in (...) second conjuncts than first conjuncts; lexical probabilities will be lower in matching second conjuncts than nonmatching ones; and syntactic repetition should be especially common for low-frequency NP expansions. Corpus analysis provides support for all three of these predictions. (shrink)

This paper presents a study of the effect of working memory load on the interpretation of pronouns in different discourse contexts: stories with and without a topic shift. We discuss a computational model (in ACT-R, Anderson, 2007) to explain how referring expressions are acquired and used. On the basis of simulations of this model, it is predicted that WM constraints only affect adults' pronoun resolution in stories with a topic shift, but not in stories without a topic shift. This latter (...) prediction was tested in an experiment. The results of this experiment confirm that WM load reduces adults' sensitivity to discourse cues signaling a topic shift, thus influencing their interpretation of subsequent pronouns. (shrink)

When people are engaged in social interaction, they can repeat aspects of each other’s communicative behavior, such as words or gestures. This kind of behavioral alignment has been studied across a wide range of disciplines and has been accounted for by diverging theories. In this paper, we review various operationalizations of lexical and gestural alignment. We reveal that scholars have fundamentally different takes on when and how behavior is considered to be aligned, which makes it difficult to compare findings and (...) draw uniform conclusions. Furthermore, we show that scholars tend to focus on one particular dimension of alignment (traditionally, whether two instances of behavior overlap in form), while other dimensions remain understudied. This hampers theory testing and building, which requires a well‐defined account of the factors that are central to or might enhance alignment. To capture the complex nature of alignment, we identify five key dimensions to formalize the relationship between any pair of behavior: time, sequence, meaning, form, and modality. We show how assumptions regarding the underlying mechanism of alignment (placed along the continuum of priming vs. grounding) pattern together with operationalizations in terms of the five dimensions. This integrative framework can help researchers in the field of alignment and related phenomena (including behavior matching, mimicry, entrainment, and accommodation) to formulate their hypotheses and operationalizations in a more transparent and systematic manner. The framework also enables us to discover unexplored research avenues and derive new hypotheses regarding alignment. (shrink)

Recent years have seen a surge in accounts motivated by information theory that consider language production to be partially driven by a preference for communicative efficiency. Evidence from discourse production (i.e., production beyond the sentence level) has been argued to suggest that speakers distribute information across discourse so as to hold the conditional per-word entropy associated with each word constant, which would facilitate efficient information transfer (Genzel & Charniak, 2002). This hypothesis implies that the conditional (contextualized) probabilities of linguistic units (...) affect speakers’ preferences during production. Here, we extend this work in two ways. First, we explore how preceding cues are integrated into contextualized probabilities, a question which so far has received little to no attention. Specifically, we investigate how a cue's maximal informativity about upcoming words (the cue's effectiveness) decays as a function of the cue's recency. Based on properties of linguistic discourses as well as properties of human memory, we analytically derive a model of cue effectiveness decay and evaluate it against cross-linguistic data from 12 languages. Second, we relate the information theoretic accounts of discourse production to well-established mechanistic (activation-based) accounts: We relate contextualized probability distributions over words to their relative activation in a lexical network given preceding discourse. (shrink)

In this article, Peter and Rowland explore the role of implicit statistical learning in syntactic development. It is often accepted that the processes observed in classic implicit learning or statistical learning experiments play an important role in the acquisition of natural language syntax. As Peter and Rowland point out, however, the results from neither research strand can be used to fully explain how children's syntax becomes adult‐like. They propose to address this shortcoming by using the structural priming paradigm.

Individuals with agrammatic Broca's aphasia experience difficulty when processing reversible non-canonical sentences. Different accounts have been proposed to explain this phenomenon. The Trace Deletion account attributes this deficit to an impairment in syntactic representations, whereas others propose that the underlying structural representations are unimpaired, but sentence comprehension is affected by processing deficits, such as slow lexical activation, reduction in memory resources, slowed processing and/or intermittent deficiency, among others. We test the claims of two processing accounts, slowed processing and intermittent deficiency, (...) and two versions of the Trace Deletion Hypothesis, in a computational framework for sentence processing implemented in ACT-R. The assumption of slowed processing is operationalized as slow procedural memory, so that each processing action is performed slower than normal, and intermittent deficiency as extra noise in the procedural memory, so that the parsing steps are more noisy than normal. We operationalize the TDH as an absence of trace information in the parse tree. To test the predictions of the models implementing these theories, we use the data from a German sentence—picture matching study reported in Hanne, Sekerina, Vasishth, Burchert, and De Bleser. The data consist of offline and online measures. From among the models considered, the model assuming that both slowed processing and intermittent deficiency are present emerges as the best model of sentence processing difficulty in aphasia. The modeling of individual differences suggests that, if we assume that patients have both slowed processing and intermittent deficiency, they have them in differing degrees. (shrink)

Rhythmic structure in speech is characterized by sequences of stressed and unstressed syllables. A large body of literature suggests that speakers of English attempt to achieve rhythmic harmony by evenly distributing stressed syllables throughout prosodic phrases. The question remains as to how speakers plan metrical structure during speech production and whether it is planned independently of phonemes. To examine this, we designed a tongue twister task consisting of disyllabic word pairs with overlapping phonological segments and either matching or non‐matching metrical (...) structure. Results showed that speakers had more difficulty producing metrically regular word pairs, compared to irregular pairs; that is, word pairs with irregular meter had faster productions and fewer speech errors in this production task. This finding of metrical regularity inhibiting production is inconsistent with an abstract metrical structure that is planned independently of phonemes at the point of phonological encoding. (shrink)

The implicit learning account of syntactic priming proposes that the same mechanism underlies syntactic priming and language development, providing a link between a child and adult language processing. The present experiment tested predictions of this account by comparing the persistence of syntactic priming effects in children and adults. Four‐year‐olds and adults first described transitive events after hearing transitive primes, constituting an exposure phase that established priming effects for passives. The persistence of this priming effect was measured in a test phase (...) as participants described further transitive events but no longer heard primes. Their production of passives was compared to a baseline group who described the same pictures without any exposure to primes. Neither immediate nor long‐term priming effects differed between children and adults but both children and adults showed significant immediate and persistent effects of the priming when the test phase occurred immediately after the exposure phase and when a short delay separated the exposure and test phase. The implications of these results for an implicit learning account of syntactic priming are discussed. (shrink)

We demonstrate that the key components of cognitive architectures (declarative and procedural memory) and their key capabilities (learning, memory retrieval, probability judgment, and utility estimation) can be implemented as algebraic operations on vectors and tensors in a high‐dimensional space using a distributional semantics model. High‐dimensional vector spaces underlie the success of modern machine learning techniques based on deep learning. However, while neural networks have an impressive ability to process data to find patterns, they do not typically model high‐level cognition, and (...) it is often unclear how they work. Symbolic cognitive architectures can capture the complexities of high‐level cognition and provide human‐readable, explainable models, but scale poorly to naturalistic, non‐symbolic, or big data. Vector‐symbolic architectures, where symbols are represented as vectors, bridge the gap between the two approaches. We posit that cognitive architectures, if implemented in a vector‐space model, represent a useful, explanatory model of the internal representations of otherwise opaque neural architectures. Our proposed model, Holographic Declarative Memory (HDM), is a vector‐space model based on distributional semantics. HDM accounts for primacy and recency effects in free recall, the fan effect in recognition, probability judgments, and human performance on an iterated decision task. HDM provides a flexible, scalable alternative to symbolic cognitive architectures at a level of description that bridges symbolic, quantum, and neural models of cognition. (shrink)

Syntactic priming in language production is the increased likelihood of using a recently encountered syntactic structure. In this paper, we examine two theories of why speakers can be primed: error‐driven learning accounts (Bock, Dell, Chang, & Onishi, 2007; Chang, Dell, & Bock, 2006) and activation‐based accounts (Pickering & Branigan, 1999; Reitter, Keller, & Moore, 2011). Both theories predict that speakers should be primed by the syntactic choices of others, but only activation‐based accounts predict that speakers should be able to prime (...) themselves. Here we test whether speakers can be primed by their own productions in three behavioral experiments and find evidence of structural persistence following both comprehension and speakers’ own productions. We also find that comprehension‐based priming effects are larger for rarer syntactic structures than for more common ones, which is most consistent with error‐driven accounts. Because neither error‐driven accounts nor activation‐based accounts fully explain the data, we propose a hybrid model. (shrink)

Linguistic repetitions in children are conceptualized as negative in children with autism – echolalia, without communicative purpose – and positive in typically developing (TD) children – linguistic alignment involved in shared engagement, common ground and language acquisition. To investigate this apparent contradiction we analyzed spontaneous speech in 67 parent–child dyads from a longitudinal corpus (30 minutes of play activities at 6 visits over 2 years). We included 32 children with autism and 35 linguistically matched TD children (mean age at recruitment (...) 32.76 and 20.27 months). We found a small number of exact repetitions in both groups (roughly 1% of utterances across visits), which increased over time in children with autism and decreased in the TD group. Partial repetitions were much more frequent: children reused caregivers' words at high rates regardless of diagnostic group (24% of utterances at first visit), and this increased in frequency (but not level) over time, faster for TD children (at final visit: 33% for autism, 40% for TD). The same happened for partial repetition of syntax and semantic alignment. However, chance alignment (as measured by surrogate pairs) also increased and findings for developmental changes were reliable only for syntactic and semantic alignment. Children with richer linguistic abilities also displayed a higher tendency to partially re–use their caregivers' language (alignment rates and semantic alignment). This highlights that all children commonly re–used the words, syntax, and topics of their caregivers, albeit with some quantitative differences, and that most repetition was at least potentially productive, with repeated language being re–contextualized and integrated with non–repeated language. The salience of echolalia in ASD might be partially explained by slight differences in frequency, amplified by lower semantic alignment, persistence over time, and expectations of echolalia. More in–depth qualitative and quantitative analyses of how repetitions are used and received in context are needed. (shrink)

This study provides evidence for implicit learning in syntactic comprehension. By reanalyzing data from a syntactic priming experiment (Thothathiri & Snedeker, 2008), we find that the error signal associated with a syntactic prime influences comprehenders' subsequent syntactic expectations. This follows directly from error‐based implicit learning accounts of syntactic priming, but it is unexpected under accounts that consider syntactic priming a consequence of temporary increases in base‐level activation. More generally, the results raise questions about the principles underlying the maintenance of implicit (...) statistical knowledge relevant to language processing, and about possible functional motivations for syntactic priming. (shrink)

Speakers often overspecify by encoding more information than is necessary when referring to an object (e.g., “the blue mug” for the only mug in a group of objects). We investigated the role of a partner's linguistic behavior (whether or not they overspecify) on a speaker's own tendency to overspecify. We used a director–matcher task in which speakers interacted with a partner who either consistently overspecified or minimally specified in the color/size dimension (Experiments 1, 2, and 3), as well as with (...) a partner who switched behaviors midway through interaction (Experiments 4 and 5). We found that speakers aligned with their partner's linguistic behavior to produce overspecific or minimally specific descriptions, and we saw little evidence that the alignment was enhanced by lexical or semantic repetition across prime and target trials. Time‐course analyses showed that alignment increased over the course of the interaction, and speakers appeared to track a change in the partner's linguistic behavior, altering their reference strategy to continue matching that of their partner's. These results demonstrate the persistent influence of a partner's behavior on speakers across the duration of an interaction. (shrink)

Cocreating meaning in collaboration is challenging. Success is often determined by people's abilities to coordinate their language to converge upon shared mental representations. Here we explore one set of low‐level linguistic behaviors, linguistic alignment, that both emerges from, and facilitates, outcomes of high‐level convergence. Linguistic alignment captures the ways people reuse, that is, “align to,” the lexical, syntactic, and semantic forms of others' utterances. Our focus is on the temporal change of multi‐level linguistic alignment, as well as how alignment is (...) related to communicative outcomes within a unique collaborative problem‐solving paradigm. The primary task, situated within a virtual educational video game, requires creative thinking between three people where the paths for possible solutions are highly variable. We find that over time interactions are marked by decreasing lexical and syntactic alignment, with a trade‐off of increasing semantic alignment. However, greater semantic alignment does not translate into better team performance. Overall, these findings provide greater clarity on the role of linguistic coordination within complex and dynamic collaborative problem‐solving tasks. (shrink)

This paper develops a novel psycholinguistic parser and tests it against experimental and corpus reading data. The parser builds on the recent research into memory structures, which argues that memory retrieval is content‐addressable and cue‐based. It is shown that the theory of cue‐based memory systems can be combined with transition‐based parsing to produce a parser that, when combined with the cognitive architecture ACT‐R, can model reading and predict online behavioral measures (reading times and regressions). The parser's modeling capacities are tested (...) against self‐paced reading experimental data (Grodner & Gibson, 2005), eye‐tracking experimental data (Staub, 2011), and a self‐paced reading corpus (Futrell et al., 2018). (shrink)

Cognitive architectures have often been applied to data from individual experiments. In this paper, I develop an ACT-R reader that can model a much larger set of data, eye-tracking corpus data. It is shown that the resulting model has a good fit to the data for the considered low-level processes. Unlike previous related works, the model achieves the fit by estimating free parameters of ACT-R using Bayesian estimation and Markov-Chain Monte Carlo techniques, rather than by relying on the mix of (...) manual selection + default values. The method used in the paper is generalizable beyond this particular model and data set and could be used on other ACT-R models. (shrink)

Lexicalized theories of syntax often assume that verb-structure regularities are mediated by lemmas, which abstract over variation in verb tense and aspect. German syntax seems to challenge this assumption, because verb position depends on tense and aspect. To examine how German speakers link these elements, a structural priming study was performed which varied syntactic structure, verb position, and verb overlap.structural priming was found, both within and across verb position, but priming was larger when the verb position was the same between (...) prime and target. Priming was boosted by verb overlap, but there was no interaction with verb position. The results can be explained by a lemma model where tense and aspect are linked to structural choices in German. Since the architecture of this lemma model is not consistent with results from English, a connectionist model was developed which could explain the cross-linguistic variation in the production system. Together, these findings support the view that language learning plays an important role in determining the nature of structural priming in different languages. (shrink)