According to embodied theories of language (ETLs), word meaning relies on sensorimotor brain areas, generally dedicated to acting and perceiving in the real world. More specifically, words denoting actions are postulated to make use of neural motor areas, while words denoting visual properties draw on the resources of visual brain areas. Therefore, there is a direct correspondence between word meaning and the experience a listener has had with a word's referent on the brain level. Behavioral and neuroimaging studies have provided (...) evidence in favor of ETLs; however, recent studies have also shown that sensorimotor information is recruited in a flexible manner during language comprehension (e.g., Raposo et al. ; Van Dam et al., ), leaving open the question as to what level of language processing sensorimotor activations contribute. In this study, we investigated the time course of modality-specific contributions (i.e., the contribution of action information) as to word processing by manipulating both (a) the linguistic and (b) the action context in which target words were presented. Our results demonstrate that processes reflecting sensorimotor information play a role early in word processing (i.e., within 200 ms of word presentation), but that they are sensitive to the linguistic context in which a word is presented. In other words, when sensorimotor information is activated, it is activated quickly; however, specific words do not reliably activate a consistent sensorimotor pattern. (shrink)

There is considerable evidence that language comprehenders derive lexical-semantic meaning by mentally simulating perceptual and motor attributes of described events. However, the nature of these simulations—including the level of detail that is incorporated and contexts under which simulations occur—is not well understood. Here, we examine the effects of first- versus third-person perspective on mental simulations during sentence comprehension. First-person sentences describing physical transfer towards or away from the body modulated response latencies when responses were made along a front-back axis, consistent (...) with the action-sentence compatibility effect. This effect was not observed for third-person sentences. The ACE was observed when making responses along a left-right axis for third-person, but not first-person sentences.sentences did not show an ACE along either axis. These results show that perspective is a detail that is simulated during action sentence comprehension, and that motoric activations are flexible and affected by the pronominal perspective used in the sentence. (shrink)

Mechanisms that contribute to perceptual processing dysfunction in schizophrenia were examined by Phillips & Silverstein, and formulated as involving disruptions in both local and higher-level coordination of signals. We agree that dysfunction in the coordination of cognitive functions (disconnection) is also indicated for many of the linguistic processing deficits documented for schizophrenia. We suggest, however, that it may be necessary to add a timing mechanism to the theoretical account.

The aim of this paper is to give an account of what it is to internalize a rule. I claim that internalization is the process of redistributing the burden of instruction from the teacher to the student. The process is complete when instruction is no longer needed, and the rule has reshaped perceptual classification of the circumstances in which it applies. Teaching a rule is the initiation of this process. We internalize rules by simulating instruction coming from someone else. Running (...) these simulations enables us to toggle between the perspective of the instructor and our own perspective. By doing this we coordinate our perspectives with that of the teacher. The account given here provides a deeper explanation of why internalizing a rule involves the dispositions and reactive attitudes proponents of Rule Consequentialism often say it does, why moral reflection is variably demanding, how intergenerational moral progress is made possible by our cognitive architectures, and why the adoption of a rule should be understood in terms of teaching that rule. (shrink)

Evidence for a dysfunction in cognitive coordination in schizophrenia is emerging, but it is not specific enough to prove (or disprove) this long-standing hypothesis. Many aspects of the external world are spatially mapped in the brain. A comprehensive internal representation relies on integration of information across space. Focus on spatial integration in the perceptual and cognitive processes will generate empirical data that shed light on the pathophysiology of schizophrenia.

In the property listing task (PLT), participants are asked to list properties for a concept (e.g., for the concept dog, “barks,” and “is a pet” may be produced). In conceptual property norming (CPNs) studies, participants are asked to list properties for large sets of concepts. Here, we use a mathematical model of the property listing process to explore two longstanding issues: characterizing the difference between concrete and abstract concepts, and characterizing semantic knowledge in the blind versus sighted population. When we (...) apply our mathematical model to a large CPN reporting properties listed by sighted and blind participants, the model uncovers significant differences between concrete and abstract concepts. Though we also find that blind individuals show many of the same processing differences between abstract and concrete concepts found in sighted individuals, our model shows that those differences are noticeably less pronounced than in sighted individuals. We discuss our results vis‐a‐vis theories attempting to characterize abstract concepts. (shrink)

There are some complex experiences, such as the experiences that allow us to understand linguistic expressions and pictures respectively, which seem to be very similar. For they are stratified experiences in which, on top of grasping certain low-level properties, one also grasps some high-level semantic-like properties. Yet first of all, those similarities notwithstanding, a phenomenologically-based reflection shows that such experiences are different. For a meaning experience has a high-level fold, in which one grasps the relevant expression’s meaning, which is not (...) perceptual, but is only based on a low-level perceptual fold that merely grasps that expression in its acoustically relevant properties. While a pictorial experience, a seeing-in experience, has two folds, the configurational and the recognitional fold, in which one respectively grasps the physical basis of a picture, its vehicle, and what the picture presents, its subject, that are both perceptual, insofar as they are intimately connected. For unlike a meaning experience, in a seeing-in experience one can perceptually read off the picture’s subject from the picture’s vehicle. Moreover, this phenomenological difference is neurologically implemented. For not only the cerebral areas that respectively implement such experiences are different, at least as far as the access to those experiences’ respective high-level content is concerned. As is shown by the fact that one can selectively be impaired in the area respectively implementing the meaning vs. the seeing-in experience without losing one’s pictorial vs. semantic competence respectively. But also, unlike meaning experiences, the area implementing the seeing-in experiential folds is perceptual as a whole. For not only a picture’s subject can be accessed earlier than an expression’s meaning, but also the neural underpinnings of such folds are located in the perceptual areas of the brain. (shrink)

It is proposed that cortical activity is normally coordinated across synaptically connected areas and that this coordination supports cognitive coherence relations. This view is consistent with the NMDA- hypoactivity hypothesis of the target article in regarding disorganization symptoms in schizophrenia as arising from disruption of normal interareal coordination. This disruption may produce abnormal contextual effects in the cortex that lead to anomalous cognitive coherence relations.

There is growing evidence that words that are acquired early in life are processed faster and more accurately than words acquired later, even by adults. As neuropsychological and neuroimaging studies have implicated different brain networks in the processing of action verbs and concrete nouns, the present study was aimed at contrasting reaction times to early and later-acquired action verbs and concrete nouns, in order to determine whether effects of word learning age express differently for the two types of words. Our (...) results show that while word frequency affected both types of words in the same way, distinct learning age effects were observed for action verbs and concrete nouns. A further experiment specified that this difference was observed for verbs describing actions belonging to the human motor repertoire, but not for verbs denoting actions past this repertoire (e.g., to neigh). We interpret these data within a recently emerging framework according to which language processing is associated with sensory motor programs. (shrink)

Phillips & Silverstein argue that a range of cognitive disturbances in schizophrenia result from a deficit in cognitive coordination attributable to NMDA receptor dysfunction. We suggest that the viability of this hypothesis would be further supported by explicit implementation in a computational framework that can produce quantitative estimates of the behavior of both healthy individuals and individuals with schizophrenia.

Thirty years ago, grounded cognition had roots in philosophy, perception, cognitive linguistics, psycholinguistics, cognitive psychology, and cognitive neuropsychology. During the next 20 years, grounded cognition continued developing in these areas, and it also took new forms in robotics, cognitive ecology, cognitive neuroscience, and developmental psychology. In the past 10 years, research on grounded cognition has grown rapidly, especially in cognitive neuroscience, social neuroscience, cognitive psychology, social psychology, and developmental psychology. Currently, grounded cognition appears to be achieving increased acceptance throughout cognitive (...) science, shifting from relatively minor status to increasing importance. Nevertheless, researchers wonder whether grounded mechanisms lie at the heart of the cognitive system or are peripheral to classic symbolic mechanisms. Although grounded cognition is currently dominated by demonstration experiments in the absence of well-developed theories, the area is likely to become increasingly theory driven over the next 30 years. Another likely development is the increased incorporation of grounding mechanisms into cognitive architectures and into accounts of classic cognitive phenomena. As this incorporation occurs, much functionality of these architectures and phenomena is likely to remain, along with many original mechanisms. Future theories of grounded cognition are likely to be heavily influenced by both cognitive neuroscience and social neuroscience, and also by developmental science and robotics. Aspects from the three major perspectives in cognitive science—classic symbolic architectures, statistical/dynamical systems, and grounded cognition—will probably be integrated increasingly in future theories, each capturing indispensable aspects of intelligence. (shrink)

The target article presents a model for schizophrenia extending four levels of abstraction: molecules, cells, cognition, and syndrome. An important notion in the model is that of coordination, applicable to both the level of cells and of cognition. The molecular level provides an “implementation” of the coordination at the cellular level, which in turn underlies the coordination at the cognitive level, giving rise to the clinical symptoms.

This commentary compares clinical aspects of ketamine with the amphetamine model of schizophrenia. Hallucinations and loss of insight, associated with amphetamine, seem more schizophrenia-like. Flat affect encountered with ketamine is closer to the clinical presentation in schizophrenia. We argue that flat affect is not a sign of schizophrenia, but rather, a risk factor for chronic schizophrenia.

Phillips & Silverstein's focus on schizophrenia as a failure of “cognitive coordination” is welcome. They note that a simple hypothesis of reduced Gamma synchronisation subserving impaired coordination does not fully account for recent observations. We suggest that schizophrenia reflects a dynamic compensation to a core deficit of coordination, expressed either as hyper- or hyposynchronisation, with neurotransmitter systems and arousal as modulatory mechanisms.

The Complex-First Paradox consists in a set of collectively incompatible but individually well-confirmed propositions that regard the evolution, development, and cortical realization of the meanings of concrete nouns. Although these meanings are acquired earlier than those of other word classes, they are semantically more complex and their cortical realizations more widely distributed. For a neurally implemented syntaxsemantics interface, it should thus take more effort to establish a link between a concept and its lexical expression. However, in ontogeny and phylogeny, capabilities (...) demanding more effort, ceteris paribus, develop and evolve later than those demanding less effort. The paradox points to an explanatory deficit in linguistic theory. (shrink)

In this paper we discuss an approach called grounded action cognition, which aims to provide a theory of the interdependencies between motor control and action-related cognitive processes, like perceiving an action or thinking about an action. The theory contrasts with traditional views in cognitive science in that it motivates an understanding of cognition as embodied, through application of Barsalou’s general idea of grounded cognition. To guide further research towards an appropriate theory of grounded action cognition we distinguish between grounding qua (...) acquisition and grounding qua constitution. On this basis, we distinguish three possible theoretical conceptions of grounded action cognition. In addition to these methodological and conceptual analyses, we draw on recent empirical evidence to motivate our inclination towards a particular theory. According to this theory certain representations are involved in action cognition and action perception that are not modality-specific as usually proposed by advocates of grounded cognition. Further, the evidence is in favor of our more specific theory stating that for some cognitive abilities, some motor abilites are constitutive. (shrink)

According to embodied theories of language (ETLs), word meaning relies on sensorimotor brain areas, generally dedicated to acting and perceiving in the real world. More specifically, words denoting actions are postulated to make use of neural motor areas, while words denoting visual properties draw on the resources of visual brain areas. Therefore, there is a direct correspondence between word meaning and the experience a listener has had with a word's referent on the brain level. Behavioral and neuroimaging studies have provided (...) evidence in favor of ETLs; however, recent studies have also shown that sensorimotor information is recruited in a flexible manner during language comprehension (e.g., Raposo et al. ; Van Dam et al., ), leaving open the question as to what level of language processing sensorimotor activations contribute. In this study, we investigated the time course of modality‐specific contributions (i.e., the contribution of action information) as to word processing by manipulating both (a) the linguistic and (b) the action context in which target words were presented. Our results demonstrate that processes reflecting sensorimotor information play a role early in word processing (i.e., within 200 ms of word presentation), but that they are sensitive to the linguistic context in which a word is presented. In other words, when sensorimotor information is activated, it is activated quickly; however, specific words do not reliably activate a consistent sensorimotor pattern. (shrink)

There is considerable evidence that language comprehenders derive lexical‐semantic meaning by mentally simulating perceptual and motor attributes of described events. However, the nature of these simulations—including the level of detail that is incorporated and contexts under which simulations occur—is not well understood. Here, we examine the effects of first‐ versus third‐person perspective on mental simulations during sentence comprehension. First‐person sentences describing physical transfer towards or away from the body (e.g., “You threw the microphone,” “You caught the microphone”) modulated response latencies (...) when responses were made along a front‐back axis, consistent with the action‐sentence compatibility effect (ACE). This effect was not observed for third‐person sentences (“He threw the microphone,” “He caught the microphone”). The ACE was observed when making responses along a left‐right axis for third‐person, but not first‐person sentences. Abstract sentences (e.g., “He heard the message”) did not show an ACE along either axis. These results show that perspective is a detail that is simulated during action sentence comprehension, and that motoric activations are flexible and affected by the pronominal perspective used in the sentence. (shrink)

The uncertainty associated with paradigmatic families has been shown to correlate with their phonetic characteristics in speech, suggesting that representations of complex sublexical relations between words are part of speaker knowledge. To better understand this, recent studies have used two-layer neural network models to examine the way paradigmatic uncertainty emerges in learning. However, to date this work has largely ignored the way choices about the representation of inflectional and grammatical functions in models strongly influence what they subsequently learn. To explore (...) the consequences of this, we investigate how representations of IFS in the input-output structures of learning models affect the capacity of uncertainty estimates derived from them to account for phonetic variability in speech. Specifically, we examine whether IFS are best represented as outputs to neural networks or as inputs by building models that embody both choices and examining their capacity to account for uncertainty effects in the formant trajectories of word final [ɐ], which in German discriminates around sixty different IFS. Overall, we find that formants are enhanced as the uncertainty associated with IFS decreases. This result dovetails with a growing number of studies of morphological and inflectional families that have shown that enhancement is associated with lower uncertainty in context. Importantly, we also find that in models where IFS serve as inputs—as our theoretical analysis suggests they ought to—its uncertainty measures provide better fits to the empirical variance observed in [ɐ] formants than models where IFS serve as outputs. This supports our suggestion that IFS serve as cognitive cues during speech production, and should be treated as such in modeling. It is also consistent with the idea that when IFS serve as inputs to a learning network. This maintains the distinction between those parts of the network that represent message and those that represent signal. We conclude by describing how maintaining a “signal-message-uncertainty distinction” can allow us to reconcile a range of apparently contradictory findings about the relationship between articulation and uncertainty in context. (shrink)

Phillips & Silverstein offer an exciting synthesis of ongoing efforts to link the clinical and cognitive manifestations of schizophrenia with cellular accounts of its pathophysiology. We applaud their efforts but wonder whether the highly inclusive notion of “context” adequately captures some important details regarding schizophrenia and NMDA/glutamate function that are suggested by work on language processing and cognitive electrophysiology.

Phillips & Silverstein's ambitious link between receptor abnormalities and the symptoms of schizophrenia involves a certain amount of fuzziness: No detailed mechanism is suggested through which the proposed abnormality would lead to psychological traits. We propose that detailed simulation of brain regions, using model neural networks, can aid in understanding the relation between biological abnormality and psychological dysfunction in schizophrenia.

Although interesting, the hypotheses proposed by Phillips & Silverstein lack unifying structure both in specific mechanisms and in cited evidence. They provide little to support the notion that low-level sensory processing and high-level cognitive coordination share dynamic grouping by synchrony as a common processing mechanism. We suggest that more realistic large-scale modeling at multiple levels is needed to address these issues.

In chronic schizophrenic patients with both positive and negative symptoms (see Table 1), interhemispheric connections at the high frequency beta2-rhythm are absent during cognitive tasks, in contrast to normal controls, who have many interhemispheric connections at this frequency in the same situation. Connectivity is a fundamental brain feature, evidently greatly promoted by the NMDA system. It is a more reliable measure of brain function than the spectral power of this rhythm.

Impairments in cognitive coordination in schizophrenia are supported by phenomenological data that suggest deficits in the processing of visual context. Although the target article is sympathetic to such a phenomenological perspective, we argue that the relevance of phenomenological data for a wider understanding of consciousness in schizophrenia is not sufficiently addressed by the authors.

Numerous searches have failed to identify a single co-occurrence of total blindness and schizophrenia. Evidence that blindness causes loss of certain NMDA-receptor functions is balanced by reports of compensatory gains. Connections between visual and anterior cingulate NMDA-receptor systems may help to explain how blindness could protect against schizophrenia.

Phillips & Silverstein argue that schizophrenia is a result of a deficit of the contextual coordination of neuronal responses. The authors propose that NMDA-receptors control these modulatory effects. However, hallucinations, which are among the principle symptoms of schizophrenia, imply a flaw in the interactions between neurons that is more fundamental than just a general weakness of contextual modulation.

The embodiment approach has shown that motor neural networks are involved in the processing of action verbs. There is developmental evidence that embodied effects on verb processing are already present in early years. Yet, the ontogenetic origin of this motor reuse in action verbs remains unknown. This longitudinal study investigates the co-occurrence of manual verbs and actions during mother-child daily routines when children were 1 to 2 and 2 to 3 years old. Eight mother-child dyads were video-recorded in 3-month intervals (...) across 12 months, and the timing of verbs and manual actions were coded by independent observers. Results showed that the probability of matched verb-action co-occurrences were much higher than that of random co-occurrences for Group 1 and Group 2, respectively. The distributions of the verb-action temporal intervals in both groups were quite symmetrical and skewed with the peak corresponding to both 0.00 s synchronic intervals and the shortest +5 s interval. Mother-led instances occurred in both groups whereas child-led instances were restricted to Group 2. Mothers pragmatically aligned their verbal productions, since they repeatedly used those verbs they shared with their children’s repertoire. In conclusion, the early multisensory communicative and manipulative scene affords grounding of verb meanings on the ongoing actions, facilitating verb-action pairing in the realm of social interactions, providing a new dimension to the prevailing solipsistic approach to embodiment. (shrink)

The purpose of this paper is to defend a conception of language that does not rely on linguistic meanings, and use it to address the Sorites and Liar paradoxes.

Phillips & Silverstein emphasize the gain-control properties of NMDA synapses in cognitive coordination. We endorse their view and suggest that NMDA synapses play a crucial role in biased attentional competition and (visual) working memory. Our simulations show that NMDA synapses can control the storage rate of visual objects. We discuss specific predictions of our model about cognitive effects of NMDA-antagonists and schizophrenia.

Neurons repeatedly exposed to similar perceptual experiences fire together and wire together to form ‘meaning kernels’ of concepts. Pulvermueller argues that abstract concepts may be devoid of meaning kernels, because the perceptual experiences that construct abstract concepts are subject to great variation and share few common features. Abstract concept are therefore grounded in the brain through features that belong to ‘meaning halos’, rather than to ‘meaning kernels’.

The concept of locally specialized functions dominates research on higher brain function and its disorders. Locally specialized functions must be complemented by processes that coordinate those functions, however, and impairment of coordinating processes may be central to some psychotic conditions. Evidence for processes that coordinate activity is provided by neurobiological and psychological studies of contextual disambiguation and dynamic grouping. Mechanisms by which this important class of cognitive functions could be achieved include those long-range connections within and between cortical regions that (...) activate synaptic channels via NMDA-receptors, and which control gain through their voltage-dependent mode of operation. An impairment of these mechanisms is central to PCP-psychosis, and the cognitive capabilities that they could provide are impaired in some forms of schizophrenia. We conclude that impaired cognitive coordination due to reduced ion flow through NMDA-channels is involved in schizophrenia, and we suggest that it may also be involved in other disorders. This perspective suggests several ways in which further research could enhance our understanding of cognitive coordination, its neural basis, and its relevance to psychopathology. Key Words: attention; cerebral cortex; cognitive coordination; cognitive neuropsychiatry; cognitive neuropsychology; context disorganization; Gamma rhythms; Gestalt theory; glutamate; grouping; memory; NMDA-receptors; PCP-psychosis; perceptual organization; schizophrenia. (shrink)

This commentary highlights methods for using scalp EEG to make inferences about contextual field interactions, which, in view of the target article, may be specially relevant to the study of schizophrenia. Although scalp EEG has limited spatial resolution, prior knowledge combined with experimental manipulations may be used to strengthen inferences about underlying brain processes. Both spatial and temporal context are discussed within the framework of nonlinear interactions. Finally, results from a visual contour integration EEG pilot study are summarized in view (...) of a hypothesis that relates receptive field and contextual field processing to evoked and induced activity, respectively. (shrink)

We propose a view of embodied representations that is alternative to both symbolic/linguistic approaches and purely sensorimotor views of cognition, and can account for procedural and declarative knowledge manipulation. In accordance with recent evidence in cognitive neuroscience and psychology, we argue that anticipatory and simulative mechanisms, which arose during evolution for action control and not for cognition, determined the first form of representational content and were exapted for increasingly sophisticated cognitive uses. In particular, procedural and declarative forms of knowledge can (...) be explained, respectively, in terms of on-line sensorimotor anticipation and off-line simulations of potential actions, which can give access to tacit knowledge and make it explicit. That is, mechanisms that evolved for the on-line prediction of the consequences of one's own actions (i.e. forward models) determine a (procedural) form of representation, and became exapted for off-line use. They can therefore be used to produce (declarative) knowledge of the world, by running a simulation of the action that would produce the relevant information. We conclude by discussing how embodied representations afford a form of internal manipulation that can be described as internalized situated action. (shrink)

Barsalou has recently argued against the strategy of identifying amodal neural representations by using their cross-modal responses (i.e., their responses to stimuli from different modalities). I agree that there are indeed modal structures that satisfy this “cross-modal response” criterion (CM), such as distributed and conjunctive modal representations. However, I argue that we can distinguish between modal and amodal structures by looking into differences in their cross-modal responses. A component of a distributed cell assembly can be considered unimodal because its responses (...) to stimuli from a given modality are stable, whereas its responses to stimuli from any other modality are not (i.e., these are lost within a short time, plausibly as a result of cell assembly dynamics). In turn, conjunctive modal representations, such as superior colliculus cells in charge of sensory integration, are multimodal because they have a stable response to stimuli from different modalities. Finally, some prefrontal cells constitute amodal representations because they exhibit what has been called ‘adaptive coding’. This implies that their responses to stimuli from any given modality can be lost when the context and task conditions are modified. We cannot assign them a modality because they have no stable relation with any input type. (shrink)

The debate between the amodal and the grounded views of cognition seems to be stuck. Their only substantial disagreement is about the vehicle or format of concepts. Amodal theorists reject the grounded claim that concepts are couched in the same modality-specific format as representations in sensory systems. The problem is that there is no clear characterization of format or its neural correlate. In order to make the disagreement empirically meaningful and move forward in the discussion we need a neurocognitive criterion (...) for representational format. I argue that efficient coding models in computational neuroscience can be used to characterize modal codes: These are codes which satisfy special informational demands imposed by sensory tasks. Additionally, I examine recent studies on neural coding and argue that although they do not provide conclusive evidence for either the grounded or the amodal views, they can be used to determine what predictions these approaches can make and what experimental and theoretical developments would be required to settle the debate. (shrink)

Although context-processing deficits may be core features of schizophrenia, context remains a poorly defined concept. To test Phillips & Silverstein's model, we need to operationalize context more precisely. We offer several useful ways of framing context and discuss enhancing or facilitating schizophrenic patients' performance under different contextual situations. Furthermore, creativity may be a byproduct of cognitive uncoordination.