Traditionally, the language faculty was supposed to be a device that maps linguistic inputs to semantic or conceptual representations. These representations themselves were supposed to be distinct from the representations manipulated by the hearer’s perceptual and motor systems. Recently this view of language has been challenged by advocates of embodied cognition. Drawing on empirical studies of linguistic comprehension, they have proposed that the language faculty reuses the very representations and processes deployed in perceiving and acting. I review some of the (...) evidence and arguments in favor of the embodied view of language comprehension, and argue that none of it is conclusive. Moreover, the embodied view itself blurs two important distinctions: first, the distinction between linguistic comprehension and its typical consequences; and second, the distinction between representational content and vehicles. Given that these distinctions are well-motivated, we have good reason to reject the embodied view of linguistic understanding.Keywords: Language; Comprehension; Perception; Action; Embodied cognition; Representation. (shrink)

Spatial aspects of words are associated with their canonical locations in the real world. Yet little research has tested whether spatial associations denoted in language comprehension generalize to their corresponding images. We directly tested the spatial aspects of mental imagery in picture and word processing (Experiment 1). We also tested whether spatial representations of motion words produce similar perceptual-interference effects as demonstrated by object words (Experiment 2). Findings revealed that words denoting an upward spatial location produced slower responses to targets (...) appearing at the top of the display, whereas words denoting a downward spatial location produced slower responses to targets appearing at the bottom of the display. Perceptual-interference effects did not obtain for pictures or for words lacking a spatial relation. These findings provide greater empirical support for the perceptual-symbols system theory (Barsalou, 1999, 2008). (shrink)

According to the Perceptual Symbols Theory of cognition (Barsalou, 1999), modality‐specific simulations underlie the representation of concepts. A strong prediction of this view is that perceptual processing affects conceptual processing. In this study, participants performed a perceptual detection task and a conceptual property‐verification task in alternation. Responses on the property‐verification task were slower for those trials that were preceded by a perceptual trial in a different modality than for those that were preceded by a perceptual trial in the same modality. (...) This finding of a modality‐switch effect across perceptual processing and conceptual processing supports the hypothesis that perceptual and conceptual representations are partially based on the same systems. (shrink)

This article provides the first comprehensive conceptual account for the imagistic mental machinery that allows us to travel through time—for the time machine in our mind. It is argued that language reveals this imagistic machine and how we use it. Findings from a range of cognitive fields are theoretically unified and a recent proposal about spatialized mental time travel is elaborated on. The following novel distinctions are offered: external versus internal viewing of time; ‘‘watching” time versus projective ‘‘travel” through time; (...) optional versus obligatory mental time travel; mental time travel into anteriority or posteriority versus mental time travel into the past or future; single mental time travel versus nested dual mental time travel; mental time travel in episodic memory versus mental time travel in semantic memory; and ‘‘seeing” versus ‘‘sensing” mental imagery. Theoretical, empirical, and applied implications are discussed. (shrink)

People often make use of a spatial “mental time line” to represent events in time. We investigated whether the eyes follow such a mental time line during online language comprehension of sentences that refer to the past, present, and future. Participants' eye movements were measured on a blank screen while they listened to these sentences. Saccade direction revealed that the future is mapped higher up in space than the past. Moreover, fewer saccades were made when two events are simultaneously taking (...) place at the present moment compared to two events that are happening in different points in time. This is the first evidence that oculomotor correlates reflect mental looking along an abstract invisible time line during online language comprehension about time. Our results support the idea that observing eye movements is likely to “detect” invisible spatial scaffoldings which are involved in cognitively processing abstract meaning, even when the abstract meaning lacks an explicit spatial correlate. Theoretical implications of these findings are discussed. (shrink)

This study investigates how speed of motion is processed in language. In three eye-tracking experiments, participants were presented with visual scenes and spoken sentences describing fast or slow events (e.g., The lion ambled/dashed to the balloon). Results showed that looking time to relevant objects in the visual scene was affected by the speed of verb of the sentence, speaking rate, and configuration of a supporting visual scene. The results provide novel evidence for the mental simulation of speed in language and (...) show that internal dynamic simulations can be played out via eye movements toward a static visual scene. (shrink)

Do we mentally simulate olfactory information? We investigated mental simulation of odors and sounds in two experiments. Participants retained a word while they smelled an odor or heard a sound, then rated odor/sound intensity and recalled the word. Later odor/sound recognition was also tested, and pleasantness and familiarity judgments were collected. Word recall was slower when the sound and sound-word mismatched. Sound recognition was higher when sounds were paired with a match or near-match word. This indicates sound-words are mentally simulated. (...) However, using the same paradigm no memory effects were observed for odor. Instead it appears odor-words only affect lexical-semantic representations, demonstrated by higher ratings of odor intensity and pleasantness when an odor was paired with a match or near-match word. These results suggest fundamental differences in how odor and sound-words are represented. (shrink)

In this commentary, I focus on Machery's criticism of Neo-Empiricism. I argue that Neo-Empiricism can survive Machery's critique, and I show that there is an empiricist strategy for forestalling eliminativism.

This paper presents an overview of the activation of background knowledge during text comprehension. We first review the cognitive processes involved in the activation of inferences during text comprehension, stressing the interaction between text and reader in the construction of situation models. Second, we review evidence for embodied theories of cognition and discuss how this new framework can inform our understanding of the nature and role of background knowledge. We then review the neuropsychological data on the activation of background knowledge (...) during text comprehension. Finally, the paper presents existing and future challenges in researching the role of background knowledge both at a conceptual and a methodological level. (shrink)

In this response to Malt's and Prinz's commentaries, I argue that neo-empiricist hypotheses fail to threaten the argument for the elimination of ‘concept’ because they are unlikely to be true of all concepts, if they are true at all. I also defend the hypothesis that we possess bodies of knowledge retrieved by default from long-term memory, and I argue that prototypes, exemplars, and theories form genuinely distinct concepts.

Whether computational algorithms such as latent semantic analysis (LSA) can both extract meaning from language and advance theories of human cognition has become a topic of debate in cognitive science, whereby accounts of symbolic cognition and embodied cognition are often contrasted. Albeit for different reasons, in both accounts the importance of statistical regularities in linguistic surface structure tends to be underestimated. The current article gives an overview of the symbolic and embodied cognition accounts and shows how meaning induction attributed to (...) a specific statistical process or to activation of embodied representations should be attributed to language itself. Specifically, the performance of LSA can be attributed to the linguistic surface structure, more than special characteristics of the algorithm, and embodiment findings attributed to perceptual simulations can be explained by distributional linguistic information. (shrink)

Name der Zeitschrift: Cognitive Linguistics Jahrgang: 27 Heft: 2 Seiten: 181-203.

Empirical evidence suggests that perceptual‐motor simulations are often constitutively involved in language comprehension. Call this “the simulation view of language comprehension”. This article applies the simulation view to illuminate the much‐discussed phenomenon of copredication, where a noun permits multiple predications which seem to select different senses of the noun simultaneously. On the proposed account, the (in)felicitousness of a copredicational sentence is closely associated with the perceptual simulations that the language user deploys in comprehending the sentence.

The Action-sentence Compatibility Effect is often taken as supporting the fundamental role of the motor system in understanding sentences that describe actions. This effect would be related to an internal “simulation,” i.e., the reactivation of past perceptual and motor experiences. However, it is not easy to establish whether this simulation predominantly involves spatial imagery or motor anticipation. In the classical ACE experiments, where a real motor response is required, the direction and motor representations are mixed. In order to disentangle spatial (...) and motor aspects involved in the ACE, we performed six experiments in different conditions, where the motor component was always reduced, asking participants to judge the sensibility of sentences by moving a mouse, thus requiring a purely spatial representation, compatible with nonmotor interpretations. In addition, our experiments had the purpose of taking into account the possible confusion of effects of practice and of compatibility. Also, in contrast to the usual paradigm, we included no-transfer filler sentences in the analysis. The ACE was not found in any experiment, a result that failed to support the idea that the ACE could be related to a simulation where spatial aspects rather than motor ones prevail. Strong practice effects were always found and were carved out from results. A surprising effect was that no-transfer sentences were processed much slower than others, perhaps revealing a sort of participants’ awareness of the structure of stimuli, i.e., their finding that some of them involved motion and others did not. The relevance of these outcomes for the embodiment theory is discussed. (shrink)

Language comprehension requires a simulation that uses neural systems involved in perception, action, and emotion. A review of recent literature as well as new experiments support five predictions derived from this framework. 1. Being in an emotional state congruent with sentence content facilitates sentence comprehension. 2. Because women are more reactive to sad events and men are more reactive to angry events, women understand sentences about sad events with greater facility than men, and men understand sentences about angry events with (...) greater facility than women. 3. Because it takes time to shift from one emotion to another, reading a sad sentence slows the reading of a happy sentence more for women than men, whereas reading an angry sentence slows the reading of a happy sentence more for men than for women. 4. Because sad states motivate affiliative actions and angry states motivate aggressive action, gender and emotional content of sentences interact with the response mode. 5. Because emotion simulation requires particular action systems, adapting those action systems will affect comprehension of sentences with emotional content congruent with the adapted action system. These results have implications for the study of language, emotion, and gender differences. (shrink)

Language is more than a source of information for accessing higher-order conceptual knowledge. Indeed, language may determine how people perceive and interpret visual stimuli. Visual processing in linguistic contexts, for instance, mirrors language processing and happens incrementally, rather than through variously-oriented fixations over a particular scene. The consequences of this atypical visual processing are yet to be determined. Here, we investigated the integration of visual and linguistic input during a reasoning task. Participants listened to sentences containing conjunctions or disjunctions and (...) looked at visual scenes containing two pictures that either matched or mismatched the nouns. Degree of match between nouns and pictures and between their expected and actual spatial positions affected fixations as well as judgments. We conclude that language induces incremental processing of visual scenes, which in turn becomes susceptible to reasoning errors during the language-meaning verification process. (shrink)

The complex-systems approach to cognitive science seeks to move beyond the formalism of information exchange and to situate cognition within the broader formalism of energy flow. Changes in cognitive performance exhibit a fractal (i.e., power-law) relationship between size and time scale. These fractal fluctuations reflect the flow of energy at all scales governing cognition. Information transfer, as traditionally understood in the cognitive sciences, may be a subset of this multiscale energy flow. The cognitive system exhibits not just a single power-law (...) relationship between fluctuation size and time scale but actually exhibits many power-law relationships, whether over time or space. This change in fractal scaling, that is, multifractality, provides new insights into changes in energy flow through the cognitive system. We survey recent findings demonstrating the role of multifractality in (a) understanding atypical developmental outcomes, and (b) predicting cognitive change. We propose that multifractality provides insights into energy flows driving the emergence of cognitive structure. (shrink)

As embodied theories of cognition are increasingly formalized and tested, care must be taken to make informed assumptions regarding the nature of concepts and representations. In this study, we outline three reasons why one cannot, in effect, represent the same concept twice. First, online perception affects offline representation: Current representational content depends on how ongoing demands direct attention to modality-specific systems. Second, language is a fundamental facilitator of offline representation: Bootstrapping and shortcuts within the computationally cheaper linguistic system continuously modify (...) representational content. Third, time itself is a source of representational change: As the content of underlying concepts shifts with the accumulation of direct and vicarious experience, so too does the content of representations that draw upon these concepts. We discuss the ramifications of these principles for research into both human and synthetic cognitive systems. (shrink)

Theories of embodied cognition hold that the conceptual system uses perceptual simulations for the purposes of representation. A strong prediction is that perceptual phenomena should emerge in conceptual processing, and, in support, previous research has shown that switching modalities from one trial to the next incurs a processing cost during conceptual tasks. However, to date, such research has been limited by its reliance on the retrieval of familiar concepts. We therefore examined concept creation by asking participants to interpret modality-specific compound (...) phrases (i.e., conceptual combinations). Results show that modality switching costs emerge during the creation of new conceptual entities: People are slower to simulate a novel concept (e.g., auditory jingling onion) when their attention has already been engaged by a different modality in simulating a familiar concept (e.g., visual shiny penny). Furthermore, these costs cannot be accounted for by linguistic factors alone. Rather, our findings support the embodied view that concept creation, as well as retrieval, requires situated perceptual simulation. (shrink)

An eye-tracking while listening study based on the blank screen paradigm was conducted to investigate the processing of literal and metaphorical verbs of motion. The study was based on two assumpti...

When describing motion along both the horizontal and vertical axes, languages from different families express the elements encoding verticality before those coding for horizontality (e.g., going up right instead of right up). In light of the motor grounding of language, the present study investigated whether the prevalence of verticality in Path expression also governs the trajectory of arm biological movements. Using a 3D virtual-reality setting, we tracked the kinematics of hand pointing movements in five spatial directions, two of which implied (...) the vertical and horizontal vectors equally (i.e., up right +45° and bottom right −45°). Movement onset could be prompted by visual or auditory verbal cues, the latter being canonical in French (“en haut à droite”/up right) or not (“à droite en haut”/right up). In two experiments, analyses of the index finger kinematics revealed a significant effect of gravity, with earlier acceleration, velocity, and deceleration peaks for upward (+45°) than downward (−45°) movements, irrespective of the instructions. Remarkably, confirming the linguistic observations, we found that vertical kinematic parameters occurred earlier than horizontal ones for upward movements, both for visual and congruent verbal cues. Non-canonical verbal instructions significantly affected this temporal dynamic: for upward movements, the horizontal and vertical components temporally aligned, while they reversed for downward movements where the kinematics of the vertical axis was delayed with respect to that of the horizontal one. This temporal dynamic is so deeply anchored that non-canonical verbal instructions allowed for horizontality to precede verticality only for movements that do not fight against gravity. Altogether, our findings provide new insights into the embodiment of language by revealing that linguistic path may reflect the organization of biological movements, giving priority to the vertical axis. (shrink)

There is mounting evidence that language comprehension involves the activation of mental imagery of the content of utterances (Barsalou, 1999;Bergen, Chang, & Narayan, 2004;Bergen, Narayan, & Feldman, 2003;Narayan, Bergen, & Weinberg, 2004;Richardson, Spivey, McRae, & Barsalou, 2003;Stanfield & Zwaan, 2001;Zwaan, Stanfield, & Yaxley, 2002). This imagery can have motor or perceptual content. Three main questions about the process remain under‐explored, however. First, are lexical associations with perception or motion sufficient to yield mental simulation, or is the integration of lexical semantics (...) into larger structures, like sentences, necessary? Second, what linguistic elements (e.g., verbs, nouns, etc.) trigger mental simulations? Third, how detailed are the visual simulations that are performed? A series of behavioral experiments address these questions, using a visual object categorization task to investigate whether up‐ or down‐related language selectively interferes with visual processing in the same part of the visual field (followingRichardson et al., 2003). The results demonstrate that either subject nouns or main verbs can trigger visual imagery, but only when used in literal sentences about real space—metaphorical language does not yield significant effects—which implies that it is the comprehension of the sentence as a whole and not simply lexical associations that yields imagery effects. These studies also show that the evoked imagery contains detail as to the part of the visual field where the described scene would take place. (shrink)

Recent research in psycholinguistics suggests that language processing frequently involves mental imagery. This paper focuses on visual imagery and discusses two issues regarding the processing of polysemous words (i.e. words with multiple related meanings or senses) – co-predication and sense-relatedness. It aims to show how mental imagery can illuminate these two issues.

Successful athletic performance requires precision in many respects. A batter stands behind home plate awaiting the arrival of a ball that is less than three inches in diameter and moving close to 100 mph. His goal is to hit it with a ba­­t that is also less than three inches in diameter. This impressive feat requires extraordinary temporal and spatial coordination. The sweet spot of the bat must be at the same place, at the same time, as the ball. A (...) basketball player must keep a ball bouncing as she speeds from one end of the court to another, evading defensive players. She may never break pace as she lifts from the ground, throwing the ball fifteen feet toward a hoop that is eighteen inches in diameter. One task facing a psychologist involves explaining how the body does such things within the sometimes very demanding spatial and temporal constraints that a given task imposes. Part of the goal of this chapter is to sketch the commitments of an embodied approach to such an explanation. We shall see that an embodied account of motor skills draws concepts that depart radically from more traditional cognitivist theories of motor activity. Similarly, because an embodied approach to cognition introduces new ways to understand the human capacity for social interaction, it also promises to shed new light on how athletes coordinate their actions with each other. (shrink)

In this paper I will analyse the relationship between metaphor and imagination. This issue has been recently studied by cognitive linguists who appreciate its importance, while other semantic perspectives neglect it. I will analyse the thesis which affirms that metaphors are based on cognitive components which are not logical-propositional but imaginative: the “image schemata” are recurrent models of corporeal experiences, centres of knowledge organization which structure – in a non-propositional form – an amount of salient information. This information emerges from (...) the sensorimotor activities such as: manipulation of objects, spatial orientation and focusing perceptive attention on different goals. According to this theory, imagination is the drive of the entire cognitive experience and, through metaphorical projection, it activates and coordinates the schemata from which the very linguistic activity originates. Starting with empirical studies about the cognitive and neurobiological plausibility of image schemata, I will assert the function of imagination as the trait d’union between experience and cognitive use of the metaphor, through the use of sensory and synesthetic metaphors as mediators among perceptive, physical and linguistic dimensions. I hope future research will concentrate on the relationship between synesthesia and image schemata because of their strong connection with human perceptive, cognitive and neural structures. (shrink)