Standard accounts of derivational morphology assume that it is incremental: some words are formed on the basis of others, and each derivational family has a base from which all of the other words are derived. The importance of the base has been questioned by paradigmatic approaches to morphology, which posit that word systems are about multidirectional relationships between words and paradigm cells, in which no word has a privileged status. This paper seeks to test which of these two views makes (...) more accurate predictions about speakers’ cognitive representations of derivational families. We perform an acceptability judgement experiment in which speakers are asked to evaluate the acceptability of a pseudoword conditional on another pseudoword in the same derivational family. We find that speakers are aware of implicative relationships between words in the same family, and that they opportunistically exploit probabilistic relationships between surface words, regardless of whether the base form is the predictor, the target of prediction, or not at all involved in the task. (shrink)

There is an active debate within the field of phonology concerning the cognitive status of substantive phonetic factors such as ease of articulation and perceptual distinctiveness. A new framework is proposed in which substance acts as a bias, or prior, on phonological learning. Two experiments tested this framework with a method in which participants are first provided highly impoverished evidence of a new phonological pattern, and then tested on how they extend this pattern to novel contexts and novel sounds. Participants (...) were found to generalize velar palatalization (e.g., the change from [k] as in keep to [t⌢∫S] as in cheap) in a way that accords with linguistic typology, and that is predicted by a cognitive bias in favor of changes that relate perceptually similar sounds. Velar palatalization was extended from the mid front vowel context (i.e., before [e] as in cape) to the high front vowel context (i.e., before [i] as in keep), but not vice versa. The key explanatory notion of perceptual similarity is quantified with a psychological model of categorization, and the substantively biased framework is formalized as a conditional random field. Implications of these results for the debate on substance, theories of phonological generalization, and the formalization of similarity are discussed. (shrink)

German nouns may alternate from singular to plural in two different ways. Some singular forms that end in a voiceless obstruent have a plural in which this obstruent is voiced. Another alternation concerns the vowel. Some singular forms with a back vowel have a plural form in which this back vowel is front. For each noun it has to be established individually whether it alternates or not. The voicing alternation is phonetically grounded, but the vowel alternation is not. Knowledge about (...) such alternations involves two things. First, it involves knowledge of which words alternate and which words do not and second, it involves the ability to extend the alternations to novel words. We studied the knowledge of which words alternate and the proportion to which they alternate in two corpus studies. We studied the knowledge of speakers concerning which words alternate and what generalizations can be based upon these words by means of a production study. The production study involved words and nonces. We asked twenty 5 year-olds, twenty 7 year-olds and tenth adults to produce the plural for a given singular word and a plural for a given singular nonce. In the corpus study we found that both alternations occur with the same frequency. In the production of alternations in words we found that participants in all age groups make few mistakes. With respect to the production of alternations in nonce words, we found that the proportion of voicing alternations decreases with age, while the proportion of vowel alternations increases. We explain this change in the ability to generalize the alternations to nonces on the basis of the confidence speakers can have in a generalization. Young children have a small lexicon and they can form relatively unreliable generalizations on lexical distributions, but they can have more confidence in their knowledge of phonetics. Adults have a large lexicon and can therefore confidently form based on their lexicon. (shrink)

Human participants and recurrent (“connectionist”) neural networks were both trained on a categorization system abstractly similar to natural language systems involving irregular (“strong”) classes and a default class. Both the humans and the networks exhibited staged learning and a generalization pattern reminiscent of the Elsewhere Condition (Kiparsky, 1973). Previous connectionist accounts of related phenomena have often been vague about the nature of the networks’ encoding systems. We analyzed our network using dynamical systems theory, revealing topological and geometric properties that can (...) be directly compared with the mechanisms of non-connectionist, rule-based accounts. The results reveal that the networks “contain” structures related to mechanisms posited by rule-based models, partly vindicating the insights of these models. On the other hand, they support the one mechanism (OM), as opposed to the more than one mechanism (MOM), view of symbolic abstraction by showing how the appearance of MOM behavior can arise emergently from one underlying set of principles. The key new contribution of this study is to show that dynamical systems theory can allow us to explicitly characterize the relationship between the two perspectives in implemented models. (shrink)

Journal Name: Cognitive Linguistics Issue: Ahead of print.

Rumelhart and McClelland's chapter about learning the past tense created a degree of controversy extraordinary even in the adversarial culture of modern science. It also stimulated a vast amount of research that advanced the understanding of the past tense, inflectional morphology in English and other languages, the nature of linguistic representations, relations between language and other phenomena such as reading and object recognition, the properties of artificial neural networks, and other topics. We examine the impact of the Rumelhart and McClelland (...) model with the benefit of 25 years of hindsight. It is not clear who “won” the debate. It is clear, however, that the core ideas that the model instantiated have been assimilated into many areas in the study of language, changing the focus of research from abstract characterizations of linguistic competence to an emphasis on the role of the statistical structure of language in acquisition and processing. (shrink)

Many generativist accounts argue for very early knowledge of inflection on the basis of very low rates of person/number marking errors in young children's speech. However, studies of Spanish and Brazilian Portuguese have revealed that these low overall error rates actually hide important differences across the verb paradigm. The present study investigated children's production of person/number marked verbs by eliciting present tense verb forms from 82 native Finnish-speaking children aged 2;2–4;8 years. Four main findings were observed: Rates of person/number marking (...) errors were higher in low-frequency person/number contexts, even excluding children who showed no evidence of having learned the relevant morpheme, most errors involved the use of higher frequency forms in lower frequency person/number contexts, error rates were predicted not only by the frequency of person/number contexts but also by the frequency of individual “ready-inflected” lexical target forms, and for low-frequency verbs, lower error rates were observed for verbs with high phonological neighborhood density. It is concluded that any successful account of the development of verb inflection will need to incorporate both rote-storage and retrieval of individual inflected forms and phonological analogy across them. (shrink)

This paper introduces a special issue of Cognitive Science initiated on the 25th anniversary of the publication of Parallel Distributed Processing (PDP), a two-volume work that introduced the use of neural network models as vehicles for understanding cognition. The collection surveys the core commitments of the PDP framework, the key issues the framework has addressed, and the debates the framework has spawned, and presents viewpoints on the current status of these issues. The articles focus on both historical roots and contemporary (...) developments in learning, optimality theory, perception, memory, language, conceptual knowledge, cognitive control, and consciousness. Here we consider the approach more generally, reviewing the original motivations, the resulting framework, and the central tenets of the underlying theory. We then evaluate the impact of PDP both on the field at large and within specific subdomains of cognitive science and consider the current role of PDP models within the broader landscape of contemporary theoretical frameworks in cognitive science. Looking to the future, we consider the implications for cognitive science of the recent success of machine learning systems called “deep networks”—systems that build on key ideas presented in the PDP volumes. (shrink)

In a series of studies children show increasing mastery of irregular plural forms (such as mice) simply by producing erroneous over‐regularized versions of them (such as mouses). We explain this phenomenon in terms of successive approximation in imitation: Children over‐regularize early in acquisition because the representations of frequent, regular plural forms develop more quickly, such that at the earliest stages of production they interfere with children's attempts to imitatively reproduce irregular forms they have heard in the input. As the strength (...) of the representations that determine children's productions settle asymptotically, the early advantage for the frequent regular forms is negated, and children's attempts to imitate the irregular forms they have observed become more likely to succeed (a process that produces the classic U‐shape in children's acquisition of plural inflection). These data show that children can acquire correct linguistic behavior without feedback in a situation where, as a result of philosophical and linguistic analyses, it has often been argued that it is logically impossible for them to do so. (shrink)

The distinction between rules and similarity is central to our understanding of much of cognitive psychology. Two aspects of existing research have motivated the present work. First, in different cognitive psychology areas we typically see different conceptions of rules and similarity; for example, rules in language appear to be of a different kind compared to rules in categorization. Second, rules processes are typically modeled as separate from similarity ones; for example, in a learning experiment, rules and similarity influences would be (...) described on the basis of separate models. In the present article, I assume that the rules versus similarity distinction can be understood in the same way in learning, reasoning, categorization, and language, and that a unified model for rules and similarity is appropriate. A rules process is considered to be a similarity one where only a single or a small subset of an object's properties are involved. Hence, rules and overall similarity operations are extremes in a single continuum of similarity operations. It is argued that this viewpoint allows adequate coverage of theory and empirical findings in learning, reasoning, categorization, and language, and also a reassessment of the objectives in research on rules versus similarity. Key Words: categorization; cognitive explanation; language; learning; reasoning; rules; similarity. (shrink)

Inflectional morphology has been taken as a paradigmatic example of rule-governed grammatical knowledge (Pinker, 1999). The plausibility of this claim may be related to the fact that it is mainly based on studies of English, which has a very simple inflectional system. We examined the representation of inflectional morphology in Serbian, which encodes number, gender, and case for nouns. Linguists standardly characterize this system as a complex set of rules, with disagreements about their exact form. We present analyses of a (...) large corpus of nouns which showed that, as in English, Serbian inflectional morphology is quasiregular: It exhibits numerous partial regularities creating neighborhoods that vary in size and consistency. We then asked whether a simple connectionist network could encode this statistical information in a manner that also supported generalization. A network trained on 3,244 Serbian nouns learned to produce correctly inflected phonological forms from a specification of a word's lemma, gender, number, and case, and generalized to untrained cases. The model's performance was sensitive to variables that also influence human performance, including surface and lemma frequency. It was also influenced by inflectional neighborhood size, a novel measure of the consistency of meaning to form mapping. A word-naming experiment with native Serbian speakers showed that this measure also affects human performance. The results suggest that, as in English, generating correctly inflected forms involves satisfying a small number of simultaneous probabilistic constraints relating form and meaning. Thus, common computational mechanisms may govern the representation and use of inflectional information across typologically diverse languages. (shrink)

Causal processes can give rise to distinctive distributions in the linguistic variables that they affect. Consequently, a secure understanding of a variable's distribution can hold a key to understanding the forces that have causally shaped it. A storied distribution in linguistics has been Zipf's law, a kind of power law. In the wake of a major debate in the sciences around power-law hypotheses and the unreliability of earlier methods of evaluating them, here we re-evaluate the distributions claimed to characterize phoneme (...) frequencies. We infer the fit of power laws and three alternative distributions to 166 Australian languages, using a maximum likelihood framework. We find evidence supporting earlier results, but also nuancing them and increasing our understanding of them. Most notably, phonemic inventories appear to have a Zipfian-like frequency structure among their most-frequent members (though perhaps also a lognormal structure) but a geometric (or exponential) structure among the least-frequent. We compare these new insights the kinds of causal processes that affect the evolution of phonemic inventories over time, and identify a potential account for why, despite there being an important role for phonetic substance in phonemic change, we could still expect inventories with highly diverse phonetic content to share similar distributions of phoneme frequencies. We conclude with priorities for future work in this promising program of research. (shrink)

Statistical learning is often taken to lie at the heart of many cognitive tasks, including the acquisition of language. One particular task in which probabilistic models have achieved considerable success is the segmentation of speech into words. However, these models have mostly been tested against English data, and as a result little is known about how a statistical learning mechanism copes with input regularities that arise from the structural properties of different languages. This study focuses on statistical word segmentation in (...) Arabic, a Semitic language in which words are built around consonantal roots. We hypothesize that segmentation in such languages is facilitated by tracking consonant distributions independently from intervening vowels. Previous studies have shown that human learners can track consonant probabilities across intervening vowels in artificial languages, but it is unknown to what extent this ability would be beneficial in the segmentation of natural language. We assessed the performance of a Bayesian segmentation model on English and Arabic, comparing consonant-only representations with full representations. In addition, we examined to what extent structurally different proto-lexicons reflect adult language. The results suggest that for a child learning a Semitic language, separating consonants from vowels is beneficial for segmentation. These findings indicate that probabilistic models require appropriate linguistic representations in order to effectively meet the challenges of language acquisition. (shrink)

Framed in psychological terms, the basic question of linguistic theory is what is stored in memory, and in what form. Traditionally, what is stored is divided into grammar and lexicon, where grammar contains the rules and the lexicon is an unstructured list of exceptions. We develop an alternative view in which rules of grammar are simply lexical items that contain variables, and in which rules have two functions. In their generative function, they are used to build novel structures, just as (...) in traditional generative linguistics. In their relational function, they capture generalizations over stored items in the lexicon, a role not seriously explored in traditional linguistic theory. The result is a highly structured lexicon with rich patterns among stored items. We further explore the possibility that this sort of structuring is not specific to language, but appears in other cognitive domains as well, such as the structure of physical objects, of music, and of geographical and social knowledge. The differences among cognitive domains do not lie in this overall texture, but in the materials over which stored relations are defined. The challenge is to develop theories of representation in these other domains comparable to that for language. (shrink)

Processes governing the creation, perception and production of spoken words are sensitive to the patterns of speech sounds in the language user’s lexicon. Generative linguistic theory suggests that listeners infer constraints on possible sound patterning from the lexicon and apply these constraints to all aspects of word use. In contrast, emergentist accounts suggest that these phonotactic constraints are a product of interactive associative mapping with items in the lexicon. To determine the degree to which phonotactic constraints are lexically mediated, we (...) observed the effects of learning new words that violate English phonotactic constraints on phonotactic perceptual repair processes in nonword consonant-consonant-vowel stimuli. Subjects who learned such words were less likely to “repair” illegal onset clusters and report them as legal ones. Effective connectivity analyses of MRI-constrained reconstructions of simultaneously collected magnetoencephalography and EEG data showed that these behavioral shifts were accompanied by changes in the strength of influences of lexical areas on acoustic-phonetic areas. These results strengthen the interpretation of previous results suggesting that phonotactic constraints on perception are produced by top-down lexical influences on speech processing. (shrink)

Evidence from aphasia is considered that leads to a distinction between abstract and concrete thought processes and hence for a distinction between rules and similarity. It is argued that perceptual classification is inherently a rule-following procedure and these rules are unable to be followed when a patient has difficulty with name comprehension and retrieval.

This paper reconsiders the diphone-based word segmentation model of Cairns, Shillcock, Chater, and Levy (1997) and Hockema (2006), previously thought to be unlearnable. A statistically principled learning model is developed using Bayes’ theorem and reasonable assumptions about infants’ implicit knowledge. The ability to recover phrase-medial word boundaries is tested using phonetic corpora derived from spontaneous interactions with children and adults. The (unsupervised and semi-supervised) learning models are shown to exhibit several crucial properties. First, only a small amount of language exposure (...) is required to achieve the model’s ceiling performance, equivalent to between 1 day and 1 month of caregiver input. Second, the models are robust to variation, both in the free parameter and the input representation. Finally, both the learning and baseline models exhibit undersegmentation, argued to have significant ramifications for speech processing as a whole. (shrink)

The debate over how best to characterize inflectional morphology has been couched largely in terms of the “dual-mechanism” approach described in Pinker (Words and rules: the ingredients of language, Basic Books, 1999) versus “single-mechanism” connectionist approaches derived from Rumelhart and McClelland (On learning past tenses of English verbs, MIT, 1986). There are, however, other single-mechanism approaches. The exemplar-based or analogical models of Daelemans et al. (TimBL: Tilburg Memory-Based Learner, version 4.3 reference guide, ILK, 2002) and Skousen (Analogical modeling of language, (...) Kluwer Academic, 1989) also model inflectional usage accurately within a single-mechanism. The most striking theoretical claim peculiar to these purely analogical models is that they do not posit any resident linguistic generalizations for processing language. Instead they process new instances of usage by comparing them systematically to remembered instances of previous usage. Based on a comparison of their Minimal Generalization Model with an adaptation of Nosofsky's (Journal of Mathematical Psychology 34: 393–418, 1990) Generalized Context Model, Albright and Hayes (Cognition 90: 119–161, 2003) argue that such purely analogical models are intrinsically inadequate for modeling the English past tense. This paper shows, however, that Skousen's (Analogical modeling of language, Kluwer Academic, 1989) Analogical Model performs as well as the Minimal Generalization Model. The implications of these results for cognitive linguistics are discussed. (shrink)

Phonological rules create alternations in the phonetic realizations of related words. These rules must be learned by infants in order to identify the phonological inventory, the morphological structure, and the lexicon of a language. Recent work proposes a computational model for the learning of one kind of phonological alternation, allophony . This paper extends the model to account for learning of a broader set of phonological alternations and the formalization of these alternations as general rules. In Experiment 1, we apply (...) the original model to new data in Dutch and demonstrate its limitations in learning nonallophonic rules. In Experiment 2, we extend the model to allow it to learn general rules for alternations that apply to a class of segments. In Experiment 3, the model is further extended to allow for generalization by context; we argue that this generalization must be constrained by linguistic principles. (shrink)

This study adjudicates between two opposing accounts of morphological productivity, using English past-tense as its test case. The single-route model posits that both regular and irregular past-tense forms are generated by analogy across stored exemplars in associative memory. In contrast, the dual-route model posits that regular inflection requires use of a formal “add -ed” rule that does not require analogy across regular past-tense forms. Children saw animations of an animal performing a novel action described with a novel verb. Past-tense forms (...) of novel verbs were elicited by prompting the child to describe what the animal “did yesterday.” Collapsing across age group, the likelihood of a verb being produced in regular past-tense form was positively associated with the verb's similarity to existing regular verbs, consistent with the single-route model only. Results indicate that children's acquisition of the English past-tense is best explained by a single-route analogical mechanism that does not incorporate a role for formal rules. (shrink)

Using the artificial language paradigm, we studied the acquisition of morphophonemic alternations with exceptions by 160 German adult learners. We tested the acquisition of two types of alternations in two regularity conditions while additionally varying length of training. In the first alternation, a vowel harmony, backness of the stem vowel determines backness of the suffix. This process is grounded in substance, and this universal phonetic factor bolsters learning a generalization. In the second alternation, tenseness of the stem vowel determines backness (...) of the suffix vowel. This process is not based in substance, but it reflects a phonotactic property of German and our participants benefit from this language-specific factor. We found that learners use both cues, while substantive bias surfaces mainly in the most unstable situation. We show that language-specific and universal factors interact in learning. (shrink)

Using the artificial language paradigm, we studied the acquisition of morphophonemic alternations with exceptions by 160 German adult learners. We tested the acquisition of two types of alternations in two regularity conditions while additionally varying length of training. In the first alternation, a vowel harmony, backness of the stem vowel determines backness of the suffix. This process is grounded in substance (phonetic motivation), and this universal phonetic factor bolsters learning a generalization. In the second alternation, tenseness of the stem vowel (...) determines backness of the suffix vowel. This process is not based in substance, but it reflects a phonotactic property of German and our participants benefit from this language-specific factor. We found that learners use both cues, while substantive bias surfaces mainly in the most unstable situation. We show that language-specific and universal factors interact in learning. (shrink)