The analysis of pure word deafness (PWD) suggests that speech perception, construed as the integration of acoustic information to yield representations that enter into the linguistic computational system, (i) is separable in a modular sense from other aspects of auditory cognition and (ii) is mediated by the posterior superior temporal cortex in both hemispheres. PWD data are consistent with neuropsychological and neuroimaging evidence in a manner that suggests that the speech code is analyzed bilaterally. The typical lateralization associated with language (...) processing is a property of the computational system that acts beyond the analysis of the input signal. The hypothesis of the bilateral mediation of the speech code does not imply that both sides execute the same computation. It is proposed that the speech signal is asymmetrically analyzed in the time domain, with left‐hemisphere mechanisms preferentially extracting information over shorter (25–50 ms) temporal integration windows and right mechanisms over longer (150–250 ms) windows. (shrink)

With some regularity, cognitive scientists seem to introduce cognitive values into their explanations. After identifying examples of this practice, I sketch an account of psychological explanation that, under certain conditions, legitimizes value-laden cognitive explanations in which evaluative claims appear in the explanandum. I then present and discuss two applications of the proposed account in order to show its viability and explore its consequences.

It is unfashionable to suggest that enactive processes - including some that involve the mirror neuron system - might contribute to the comprehension of sign language. The present essay formulates and defends a version of that unfashionable suggestion, as it applies to certain forms of syntactic processing. There is evidence that has been thought to weigh against any such suggestion, coming from neuroimaging experiments and from the study of Deaf aphasics. In both cases it is shown to be unpersuasive.

This paper proposes an Interface Transparency Thesis concerning how linguistic meanings are related to the cognitive systems that are used to evaluate sentences for truth/falsity: a declarative sentence S is semantically associated with a canonical procedure for determining whether S is true; while this procedure need not be used as a verification strategy, competent speakers are biased towards strategies that directly reflect canonical specifications of truth conditions. Evidence in favor of this hypothesis comes from a psycholinguistic experiment examining adult judgments (...) concerning ‘Most of the dots are blue’. This sentence is true if and only if the number of blue dots exceeds the number of nonblue dots. But this leaves unsettled, e.g., how the second cardinality is specified for purposes of understanding and/or verification: via the nonblue things, given a restriction to the dots, as in ‘|{x: Dot(x) & ~Blue(x)}|’; via the blue things, given the same restriction, and subtraction from the number of dots, as in ‘|{x: Dot(x)}| – |{x: Dot(x) & Blue(x)}|’; or in some other way. Psycholinguistic evidence and psychophysical modeling support the second hypothesis. (shrink)

Multiple acoustic dimensions signal speech categories. However, dimensions vary in their informativeness; some are more diagnostic of category membership than others. Speech categorization reflects these dimensional regularities such that diagnostic dimensions carry more “perceptual weight” and more effectively signal category membership to native listeners. Yet perceptual weights are malleable. When short-term experience deviates from long-term language norms, such as in a foreign accent, the perceptual weight of acoustic dimensions in signaling speech category membership rapidly adjusts. The present study investigated whether (...) rapid adjustments in listeners’ perceptual weights in response to speech that deviates from the norms also affects listeners’ own speech productions. In a word recognition task, the correlation between two acoustic dimensions signaling consonant categories, fundamental frequency and voice onset time, matched the correlation typical of English, and then shifted to an “artificial accent” that reversed the relationship, and then shifted back. Brief, incidental exposure to the artificial accent caused participants to down-weight perceptual reliance on F0, consistent with previous research. Throughout the task, participants were intermittently prompted with pictures to produce these same words. In the block in which listeners heard the artificial accent with a reversed F0 × VOT correlation, F0 was a less robust cue to voicing in listeners’ own speech productions. The statistical regularities of short-term speech input affect both speech perception and production, as evidenced via shifts in how acoustic dimensions are weighted. (shrink)

Social and linguistic perceptions are linked. On one hand, talker identity affects speech perception. On the other hand, speech itself provides information about a talker's identity. Here, we propose that the same probabilistic knowledge might underlie both socially conditioned linguistic inferences and linguistically conditioned social inferences. Our computational–level approach—the ideal adapter—starts from the idea that listeners use probabilistic knowledge of covariation between social, linguistic, and acoustic cues in order to infer the most likely explanation of the speech signals they hear. (...) As a first step toward understanding social inferences in this framework, we use a simple ideal observer model to show that it would be possible to infer aspects of a talker's identity using cue distributions based on actual speech production data. This suggests the possibility of a single formal framework for social and linguistic inferences and the interactions between them. (shrink)

Multimodal integration is the formation of a coherent percept from different sensory inputs such as vision, audition, and somatosensation. Most research on multimodal integration in speech perception has focused on audio-visual integration. In recent years, audio-tactile integration has also been investigated, and it has been established that puffs of air applied to the skin and timed with listening tasks shift the perception of voicing by naive listeners. The current study has replicated and extended these findings by testing the effect of (...) air puffs on gradations of voice onset time along a continuum rather than the voiced and voiceless endpoints of the original work. Three continua were tested: bilabial (“pa/ba”), velar (“ka/ga”), and a vowel continuum (“head/hid”) used as a control. The presence of air puffs was found to significantly increase the likelihood of choosing voiceless responses for the two VOT continua but had no effect on choices for the vowel continuum. Analysis of response times revealed that the presence of air puffs lengthened responses for intermediate (ambiguous) stimuli and shortened them for endpoint (non-ambiguous) stimuli. The slowest response times were observed for the intermediate steps for all three continua, but for the bilabial continuum this effect interacted with the presence of air puffs: responses were slower in the presence of air puffs, and faster in their absence. This suggests that during integration auditory and aero-tactile inputs are weighted differently by the perceptual system, with the latter exerting greater influence in those cases where the auditory cues for voicing are ambiguous. (shrink)

A fundamental problem in spoken language is the duality between the continuous aspects of phonetic performance and the discrete aspects of phonological competence. We study 2 instances of this problem from the phenomenon of voicing neutralization and vowel harmony. In each case, we present a model where the experimentally observed continuous distinctions are linked to the discreteness of phonological form using the mathematics of nonlinear dynamics.

According to sensorimotor theory perceiving is a bodily skill involving exercise of an implicit know-how of the systematic ways that sensations change as a result of potential movements, that is, of sensorimotor contingencies. The theory has been most successfully applied to vision and touch, while perceptual modalities that rely less on overt exploration of the environment have not received as much attention. In addition, most research has focused on philosophically grounding the theory and on psychologically elucidating sensorimotor laws, but the (...) theory’s ramifications for neuroscience still remain underexamined. Here we sketch the beginnings of a research program that could address these two outstanding challenges in terms of auditory perception. We review the neuroscience literature on passive listening, which is defined as listening without overt bodily movement, and conclude that sensorimotor theory provides a unique perspective on the consistent finding of motor system activation. In contrast to competing theories, this activation is predicted to be involved not only in the perception of speech- and action-related sounds, but in auditory perception in general. More specifically, we propose that the auditory processing associated with supplementary motor areas forms part of the neural basis of the exercise of sensorimotor know-how: these areas’ recognized role in facilitating spontaneous motor responses to sound and supporting flexible engagement of sensorimotor processes to guide auditory experience and enable auditory imagery, can be understood in terms of two key characteristics of sensorimotor interaction, its “alerting capacity” and “corporality”, respectively. We also highlight that there is more to the inside of the body than the brain: there is an opportunity to develop sensorimotor theory into new directions in terms of the still poorly understood active processes of the peripheral auditory system. (shrink)

For many years the evolution of language has been seen as a disreputable topic, mired in fanciful “just so stories” about language origins. However, in the last decade a new synthesis of modern linguistics, cognitive neuroscience and neo-Darwinian evolutionary theory has begun to make important contributions to our understanding of the biology and evolution of language. I review some of this recent progress, focusing on the value of the comparative method, which uses data from animal species to draw inferences about (...) language evolution. Discussing speech first, I show how data concerning a wide variety of species, from monkeys to birds, can increase our understanding of the anatomical and neural mechanisms underlying human spoken language, and how bird and whale song provide insights into the ultimate evolutionary function of language. I discuss the “descended larynx” of humans, a peculiar adaptation for speech that has received much attention in the past, which despite earlier claims is not uniquely human. Then I will turn to the neural mechanisms underlying spoken language, pointing out the difficulties animals apparently experience in perceiving hierarchical structure in sounds, and stressing the importance of vocal imitation in the evolution of a spoken language. Turning to ultimate function, I suggest that communication among kin (especially between parents and offspring) played a crucial but neglected role in driving language evolution. Finally, I briefly discuss phylogeny, discussing hypotheses that offer plausible routes to human language from a non-linguistic chimp-like ancestor. I conclude that comparative data from living animals will be key to developing a richer, more interdisciplinary understanding of our most distinctively human trait: language. (shrink)

There is converging evidence from developmental and cognitive psychology, as well as from neuroscience, to suggest that the self is both special and social, and that self-other interaction is the driving force behind self-development. We review experimental findings which demonstrate that human infants are motivated for social interactions and suggest that the development of an awareness of other minds is rooted in the implicit notion that others are like the self. We then marshal evidence from functional neuroimaging explorations of the (...) neurophysiological substrate of shared representations between the self and others, using various ecological paradigms such as mentally representing one's own actions versus others' actions, watching the actions executed by others, imitating the others' actions versus being imitated by others. We suggest that within this shared neural network the inferior parietal cortex and the prefrontal cortex in the right hemisphere play a special role in the essential ability to distinguish the self from others, and in the way the self represents the other. Interestingly, the right hemisphere develops its functions earlier than the left. (shrink)

Jerry Fodor deemed informational encapsulation ‘the essence’ of a system’s modularity and argued that human perceptual processing comprises modular systems, thus construed. Nowadays, his conclusion is widely challenged. Often, this is because experimental work is seen to somehow demonstrate the cognitive penetrability of perceptual processing, where this is assumed to conflict with the informational encapsulation of perceptual systems. Here, I deny the conflict, proposing that cognitive penetration need not have any straightforward bearing on the conjecture that perceptual processing is composed (...) of nothing but informationally encapsulated modules, the conjecture that each and every perceptual computation is performed by an informationally encapsulated module, and the consequences perceptual encapsulation was traditionally expected to have for a perception-cognition border, the epistemology of perception and cognitive science. With these points in view, I propose that particularly plausible cases of cognitive penetration would actually seem to evince the encapsulation of perceptual systems rather than refute/problematize this conjecture. (shrink)

The current study examines the self-voice benefit in an early bilingual population. Female Cantonese–English bilinguals produced words containing Cantonese contrasts. A subset of these minimal pairs was selected as stimuli for a perception task. Speakers’ productions were grouped according to how acoustically contrastive their pronunciation of each minimal pair was and these groupings were used to design personalized experiments for each participant, featuring their own voice and the voices of others’ similarly-contrastive tokens. The perception task was a two-alternative forced-choice word (...) identification paradigm in which participants heard isolated Cantonese words, which had undergone synthesis to mask the original talker identity. Listeners were more accurate in recognizing minimal pairs produced in their own voice than recognizing the realizations of speakers who maintain similar degrees of phonetic contrast for the same minimal pairs. Generally, individuals with larger phonetic contrasts were also more accurate in word identification for self and other voices overall. These results provide evidence for an own-voice benefit for early bilinguals. These results suggest that the phonetic distributions that undergird phonological contrasts are heavily shaped by one’s own phonetic realizations. (shrink)

Judea Pearl has argued that counterfactuals and causality are central to intelligence, whether natural or artificial, and has helped create a rich mathematical and computational framework for formally analyzing causality. Here, we draw out connections between these notions and various current issues in cognitive science, including the nature of mental “programs” and mental representation. We argue that programs (consisting of algorithms and data structures) have a causal (counterfactual-supporting) structure; these counterfactuals can reveal the nature of mental representations. Programs can also (...) provide a causal model of the external world. Such models are, we suggest, ubiquitous in perception, cognition, and language processing. (shrink)

We suggest that pain processing has a modular architecture. We begin by motivating the (widely assumed but seldom defended) conjecture that pain processing comprises inferential mechanisms. We then note that pain exhibits a characteristic form of judgement independence. On the assumption that pain processing is inferential, we argue that its judgement independence is indicative of modular (encapsulated) mechanisms. Indeed, we go further, suggesting that it renders the modularity of pain mechanisms a default hypothesis to be embraced pending convincing counterevidence. Finally, (...) we consider what a modular pain architecture might look like, and question alleged counterevidence to our proposal. (shrink)

Modules are widely held to play a central role in explaining mental development and in accounts of the mind generally. But there is much disagreement about what modules are, which shows that we do not adequately understand modularity. This paper outlines a Fodoresque approach to understanding one type of modularity. It suggests that we can distinguish modular from nonmodular cognition by reference to the kinds of process involved, and that modular cognition differs from nonmodular forms of cognition in being a (...) special kind of computational process. The paper concludes by considering implications for the role of modules in explaining mental development. (shrink)