Rumelhart and McClelland's chapter about learning the past tense created a degree of controversy extraordinary even in the adversarial culture of modern science. It also stimulated a vast amount of research that advanced the understanding of the past tense, inflectional morphology in English and other languages, the nature of linguistic representations, relations between language and other phenomena such as reading and object recognition, the properties of artificial neural networks, and other topics. We examine the impact of the Rumelhart and McClelland (...) model with the benefit of 25 years of hindsight. It is not clear who “won” the debate. It is clear, however, that the core ideas that the model instantiated have been assimilated into many areas in the study of language, changing the focus of research from abstract characterizations of linguistic competence to an emphasis on the role of the statistical structure of language in acquisition and processing. (shrink)

This paper introduces a special issue of Cognitive Science initiated on the 25th anniversary of the publication of Parallel Distributed Processing (PDP), a two-volume work that introduced the use of neural network models as vehicles for understanding cognition. The collection surveys the core commitments of the PDP framework, the key issues the framework has addressed, and the debates the framework has spawned, and presents viewpoints on the current status of these issues. The articles focus on both historical roots and contemporary (...) developments in learning, optimality theory, perception, memory, language, conceptual knowledge, cognitive control, and consciousness. Here we consider the approach more generally, reviewing the original motivations, the resulting framework, and the central tenets of the underlying theory. We then evaluate the impact of PDP both on the field at large and within specific subdomains of cognitive science and consider the current role of PDP models within the broader landscape of contemporary theoretical frameworks in cognitive science. Looking to the future, we consider the implications for cognitive science of the recent success of machine learning systems called “deep networks”—systems that build on key ideas presented in the PDP volumes. (shrink)

This article presents a sobering view of the discipline of cognitive neuropsychology as practiced over the last three or four decades. Our judgment is that, although the study of abnormal cognition resulting from brain injury or disease in previously normal adults has produced a catalogue of fascinating and highly selective deficits, it has yielded relatively little advance in understanding how the brain accomplishes its cognitive business. We question the wisdom of the following three “choices” in mainstream cognitive neuropsychology: (a) single‐case (...) methodology, (b) dissociation between functions as the most important source of evidence, and (c) a central goal of diagramming the functional architecture of cognition rather than specifying how its components work. These choices may all stem from an excessive commitment to strict and fine‐grained modularity. Although different brain regions are undoubtedly specialized for different functions, we argue that parallel and interactive processing is a better assumption about cognitive processing. The essential goal of specifying representations and processes can, we claim, be significantly assisted by computational modeling which, by its very nature, requires such specification. (shrink)

Individuals with agrammatic Broca's aphasia experience difficulty when processing reversible non-canonical sentences. Different accounts have been proposed to explain this phenomenon. The Trace Deletion account attributes this deficit to an impairment in syntactic representations, whereas others propose that the underlying structural representations are unimpaired, but sentence comprehension is affected by processing deficits, such as slow lexical activation, reduction in memory resources, slowed processing and/or intermittent deficiency, among others. We test the claims of two processing accounts, slowed processing and intermittent deficiency, (...) and two versions of the Trace Deletion Hypothesis, in a computational framework for sentence processing implemented in ACT-R. The assumption of slowed processing is operationalized as slow procedural memory, so that each processing action is performed slower than normal, and intermittent deficiency as extra noise in the procedural memory, so that the parsing steps are more noisy than normal. We operationalize the TDH as an absence of trace information in the parse tree. To test the predictions of the models implementing these theories, we use the data from a German sentence—picture matching study reported in Hanne, Sekerina, Vasishth, Burchert, and De Bleser. The data consist of offline and online measures. From among the models considered, the model assuming that both slowed processing and intermittent deficiency are present emerges as the best model of sentence processing difficulty in aphasia. The modeling of individual differences suggests that, if we assume that patients have both slowed processing and intermittent deficiency, they have them in differing degrees. (shrink)

Humans can pronounce a nonword. Some researchers have interpreted this behavior as requiring a sequential mechanism by which a grapheme-phoneme correspondence rule is applied to each grapheme in turn. However, several parallel-distributed processing models in English have simulated human nonword reading accuracy without a sequential mechanism. Interestingly, the Japanese psycholinguistic literature went partly in the same direction, but it has since concluded that a sequential parsing mechanism is required to reproduce human nonword reading accuracy. In this study, by manipulating the (...) list composition, we demonstrated that past psycholinguistic studies in Japanese have overestimated human nonword reading accuracy. When the more fairly reevaluated human performance was targeted, a newly implemented Japanese PDP model simulated the target accuracy as well as the error patterns. These findings suggest that PDP models are a more parsimonious way of explaining reading across various languages. (shrink)

Studies have suggested that visually presented words are obligatorily decomposed into constituents that could be mapped to language representations. The present study aims to elucidate how orthographic processing of one constituent affects the other and vice versa during a word recognition task. Chinese orthographic system has characters representing syllables and meanings instead of suffixation roles, and the majority of Chinese characters are phonograms that can be further decomposed into phonetic radical and semantic radical. We propose that semantic radical combinability indexed (...) by semantic radicals and the effect of phonological consistency indexed by phonetic radicals would interact with each other during the reading of Chinese phonograms. Twenty-six right-handed native Chinese speakers were recruited to the study. Participants were presented with phonograms divided into four conditions following their semantic radical combinability and phonological consistency. EEG signals were recorded throughout the covert naming task. Our results show that there is an interaction effect between phonological consistency and semantic radical combinability on the right hemisphere N170 activity while reading phonograms. Semantic radical combinability influenced the right hemisphere N170 during the process of low-consistency character reading but not high-consistency character reading. On the other hand, the left hemisphere N170 revealed a more significant activity during reading high-consistency characters and was not affected by radical combinability. In addition, while low-consistency characters revealed a larger P200 than high-consistency characters, the semantic radical combinability effect on P200 was only significant when participants were reading high-consistency characters but not low-consistency characters. These results provide new information about how ERPs are involved in word recognition within the context of interaction among orthographic and phonological dimensions. (shrink)

The paper makes three points about the role of double dissociation in cognitive neuropsychology. First, arguments from double dissociation to separate modules work by inference to the best, not the only possible, explanation. Second, in the development of computational cognitive neuropsychology, the contribution of connectionist cognitive science has been to broaden the range of potential explanations of double dissociation. As a result, the competition between explanations, and the characteristic features of the assessment of theories against the criteria of probability and (...) explanatory value, are more visible. Third, cognitive neuropsychology is a division of cognitive psychology but the practice of cognitive neuropsychology proceeds on assumptions that go beyond the subject matter of cognitive psychology. Given such assumptions, neuroscientific findings about lesion location may enhance the value of double dissociation in shifting the balance of support between cognitive theories. (shrink)