This study examines the visual representation of diegetic time in visual narrative stories, and explores why the invisible diegetic time flow could be expressed through visible elements, and how patterns and textures could be used to specify states of happenings. The study demonstrates that metaphorical relations between time and space are visually realized in visual narratives, leading to the representation of diegetic time and its related concepts on different levels of two-dimensional space. The segmentation of page space and the visual (...) components within panel space are employed to build a diegetic timeline as well as specify temporal aspects of actions and states in visual narrative stories. Neuroscientific evidence which suggests that a common metric is used to compute magnitudes of time and space in the human brain might help explain why time as an abstract concept could undergo visual materialization in visual narratives. (shrink)

This study recruited English monolinguals, Mandarin monolinguals, and Mandarin–English bilinguals to examine whether native English and native Mandarin speakers think about time differently and whether the acquisition of L2 English could reshape native Mandarin speakers’ mental representations of temporal sequence. Across two experiments, we used the temporal congruency categorization paradigm which involved two-alternative forced-choice reaction time tasks to contrast experimental conditions that were assumed to be either compatible or incompatible with the internal spatiotemporal associations. Results add to previous studies by (...) confirming that native English and native Mandarin speakers do think about time differently, and the significant crosslinguistic discrepancy primarily lies in the vertical representations of time flow. However, current findings also clarify the existing literature, demonstrating that the acquisition of L2 English does not appear to affect native Mandarin speakers’ temporal cognition. ME bilinguals, irrespective of whether they attained elementary or advanced level of English proficiency, exhibited temporal thinking patterns commensurate with those of Mandarin monolinguals. Some theoretical implications regarding the effect of bilingualism on cognition in general can be drawn from the present study, a crucial one being that it provides evidence against the view that L2 acquisition can reshape habitual modes of thinking established by L1. (shrink)

Mandarin speakers, like most other language speakers around the world, use spatial terms to talk about time. However, the direction of their mental temporal representation along the front-back axis remains controversial because they use the spatial term “front” to refer to both earlier times and the future. Although the linguistic distinction between time- and ego-reference-point spatiotemporal metaphors in Mandarin suggests a promising clarification of the above controversy, there is little empirical evidence verifying this distinction. In this study, Mandarin speakers’ time- (...) and ego-reference-point temporal representations on three axes were separately examined through two tasks. In a time-reference-point task, Mandarin speakers judged whether the time point of the second picture was earlier or later than the time point of the first picture, while in an ego-reference-point task, they judged whether an event or phase had happened in the past or would happen in the future. The results indicate that Mandarin speakers construe an earlier-times-in-front-of-later-times temporal sequence and adopt the front-to-the-future orientation. (shrink)

Reasoning about bedrock abstract concepts such as time, number, and valence relies on spatial metaphor and often on multiple spatial metaphors for a single concept. Previous research has documented, for instance, both future-in-front and future-to-right metaphors for time in English speakers. It is often assumed that these metaphors, which appear to have distinct experiential bases, remain distinct in online temporal reasoning. In two studies we demonstrate that, contra this assumption, people systematically combine these metaphors. Evidence for this combination was found (...) in both directly elicited and spontaneous co-speech gestures about time. These results provide first support for the hypothesis that the metaphorical representation of time, and perhaps other abstract domains as well, involves the continuous co-activation of multiple metaphors rather than the selection of only one. (shrink)

Several reaction time (RT) studies report faster responses when responses to temporal information are arranged in a spatially congruent manner than when this arrangement is incongruent. The resulting space–time congruency effect is commonly attributed to a culturally salient localization of temporal information along a mental timeline (e.g., a mental timeline that runs from left to right). The present study aims to provide a compilation of the published RT studies on this time–space association in order to estimate the size of its (...) effect and the extent of potential publication bias in this field of research. In this meta-analysis, three types of task are distinguished due to hitherto existing empirical findings. These findings suggest that the extent to which time is made relevant to the experimental task has a systematic impact on whether or not the mental timeline is activated. The results of this meta-analysis corroborate these considerations: First, experiments that make time a task-relevant dimension have a mean effect size of d = 0.46. Second, in experiments in which time is task irrelevant, the effect size does not significantly deviate from zero. Third, temporal priming studies have a surprisingly high mean effect size of d = 0.47, which, however, should be adjusted to d = 0.36 due to publication bias. (shrink)

This study investigates how typological and metaphorical construal differences may affect the use and frequency of temporal expressions in English and Spanish. More precisely, we explore whether there are any differences between English, a satellite-framed language, and Spanish, a verb-framed language, in the use of certain temporal linguistic expressions that include a spatial, deictic component (Deictic Time), a purely temporal relation between two events (Sequential Time) or the expression of the duration of an event (Duration). To achieve this, we perform (...) two different types of analysis. First, we conduct an informational gain or loss analysis (Verkerk, 2013) of 1,650 of English-to-Spanish translations extracted from parallel corpora. Secondly, we compare the frequency of 33 English and 27 Spanish temporal expressions in two similar written online corpora (EnTenTen and EsTenTen, respectively) and a television news spoken corpus (NewsScape). Our results suggest that English uses “deictic directional expressions” (explicitly stating the spatial location of the temporal event,, e.g., back in those days/in the future ahead) much more frequently than Spanish, to the extent that directional information is normally excluded in English-to-Spanish translations. Also, sequential expressions (such as before that/later than) and duration expressions (during the whole day) are much more frequent in Spanish. These usage differences, explained by the variability in motion typology and metaphoric construal, open up the interesting question of how these differences in linguistic usage could affect the conceptualization of time of English and Spanish speakers. (shrink)

This study investigates whether there is a relation between the semantics of linguistic expressions that indicate temporal distance and the spatial properties of their co-speech gestures. To this date, research on time gestures has focused on features such as gesture axis, direction, and shape. Here we focus on a gesture property that has been overlooked so far: the distance of the gesture in relation to the body. To achieve this, we investigate two types of temporal linguistic expressions are addressed: proximal (...) (e.g., near future, near past) and distal (e.g., distant past, distant future). Data was obtained through the NewsScape library, a multimodal corpus of television news. A total of 121 co-speech gestures were collected and divided into the two categories. The gestures were later annotated in terms of gesture space and classified in three categories: (i) center, (ii) periphery, and (iii) extreme periphery. Our results suggest that gesture and language are coherent in the expression of temporal distance: when speakers locate an event far from them, they tend to gesture further from their body; similarly, when locating an event close to them, they gesture closer to their body. These results thus reveal how co-speech gestures also reflect a space-time mapping in the dimension of distance. (shrink)

Our earliest tools are our bodies. Our hands raise and turn and toss and carry and push and pull, our legs walk and climb and kick allowing us to move and act in the world and to create the multitude of artifacts that improve our lives. The list of actions made by our hands and feet and other parts of our bodies is long. What is more remarkable is we turn those actions in the world into actions on thought through (...) gestures, language, and graphics, thereby creating cognitive tools that expand the mind. The focus here is gesture; gestures transform actions on perceptible objects to actions on imagined thoughts, carrying meaning with them rapidly, precisely, and directly. We review evidence showing that gestures enhance our own thinking and change the thought of others. We illustrate the power of gestures in studies showing that gestures uniquely change conceptions of time, from sequential to simultaneous, from sequential to cyclical, and from a perspective embedded in a timeline to an external perspective looking on a timeline, and by so doing obviate the ambiguities of an embedded perspective. We draw parallels between representations in gesture and in graphics; both use marks or actions arrayed in space to communicate more immediately than symbolic language. (shrink)

Name der Zeitschrift: Cognitive Linguistics Jahrgang: 27 Heft: 2 Seiten: 205-233.

People often make use of a spatial “mental time line” to represent events in time. We investigated whether the eyes follow such a mental time line during online language comprehension of sentences that refer to the past, present, and future. Participants' eye movements were measured on a blank screen while they listened to these sentences. Saccade direction revealed that the future is mapped higher up in space than the past. Moreover, fewer saccades were made when two events are simultaneously taking (...) place at the present moment compared to two events that are happening in different points in time. This is the first evidence that oculomotor correlates reflect mental looking along an abstract invisible time line during online language comprehension about time. Our results support the idea that observing eye movements is likely to “detect” invisible spatial scaffoldings which are involved in cognitively processing abstract meaning, even when the abstract meaning lacks an explicit spatial correlate. Theoretical implications of these findings are discussed. (shrink)

Journal Name: Cognitive Linguistics Issue: Ahead of print.

Name der Zeitschrift: Cognitive Linguistics Jahrgang: 27 Heft: 1 Seiten: 35-65.

One of the core tenets of cognitive metaphor theory is the claim that metaphors ground abstract knowledge in concrete, first-hand experience. In this paper, I argue that this grounding hypothesis contains some problematic conceptual ambiguities and, under many reasonable interpretations, empirical difficulties. I present evidence that there are foundational obstacles to defining a coherent and cognitively valid concept of “metaphor” and “concrete meaning,” and some general problems with singling out certain domains of experience as more immediate than others. I conclude (...) from these considerations that whatever the facts are about the comprehension of individual metaphors, the available evidence is incompatible with the notion of an underlying conceptual structure organized according to the immediacy of experience. (shrink)

Most native speakers of Spanish are intuitively able to construct correct structures with the marker ‘se’. On the other hand, non-native speakers, even those at advanced proficiency levels, have difficulties producing most constructions with ‘se’. This is hardly surprising as the marker ‘se’, one of the most common words in Spanish, can convey highly pragmatic nuances with a variety of functions that are still much debated among linguists. This study analyses some of the most used functions of the marker in (...) the oral production of 18 Peninsular Spanish speakers from a multimodal Cognitive Grammar approach, identifying how gestures might be employed by speakers to create or clarify meaning. Our results confirm that gestures are used differently depending on the function of the marker. Middle voices where ‘se’ marks high levels of subject involvement and/or energy co-occur with related gestures, while middle voices or impersonal structures, where the involvement and/or energy is low, co-occur more often with unrelated gestures, if any. (shrink)

Previous research suggests that both patterns in orthography and cultural-specific associations of space-time affect how people map space onto time. In the current study, we focused on Chinese Buddhists, an understudied population, investigating how religious experiences influence their mental representations of time. Results showed that Chinese Buddhists could represent time spatially corresponding to left-to-right, right-to-left and top-to-bottom orientations in their religious scripts. Specifically, they associated earlier events with the starting point of the reading and later times with the endpoint. We (...) also found that Chinese Buddhists were more likely to represent time in a clockwise way than Chinese atheists. This is because Buddhism regards time as cyclic and consisting of repeating ages (i.e. Wheel of Time). Taken together, we provide first psychological evidence that Chinese Buddhists’ spatial representations of time are different from atheists’, due to their religious experiences, namely, both the reading direction in Buddhist texts and Buddhist concepts of time. (shrink)

People implicitly associate the “past” and “future” with “front” and “back” in their minds according to their cultural attitudes toward time. As the temporal focus hypothesis proposes, future-oriented people tend to think about time according to the future-in-front mapping, whereas past-oriented people tend to think about time according to the past-in-front mapping. Whereas previous studies have demonstrated that culture exerts an important influence on people's implicit spatializations of time, we focus specifically on religion, a prominent layer of culture, as potential (...) additional influence on space-time mappings. In Experiment 1 and 2, we observed a difference between the two religious groups, with Buddhists being more past-focused and more frequently conceptualizing the past as ahead of them and the future as behind them, and Taoists more future-focused and exhibiting the opposite space-time mapping. In Experiment 3, we administered a religion prime, in which Buddhists were randomly assigned to visualize the picture of the Buddhas of the Past or the Future. Results showed that the pictorial icon of Dipamkara increased participants' tendency to conceptualize the past as in front of them. In contrast, the pictorial icon of Maitreya caused a dramatic increase in the rate of future-in-front responses. In Experiment 4, the causal effect of religion on implicit space-time mappings was replicated in atheists. Taken together, these findings provide converging evidence for the hypothesized causal role of religion for temporal focus in determining space-time mappings. (shrink)

Representational transformation is a technique for deepening our understanding of mathematical concepts and facilitating the process of solving mathematical problems. This article suggests that representational transformation can contribute to thought processes in four ways. Firstly, representational transformation helps people employ a wider range of cognitive resources. When one representation of a concept or a problem is transformed into another representation, the sensory-motor resources that are involved in the processing of the base representation are employed to process the target representation. Secondly, (...) representational transformation helps in the process of organizing scattered information into suitable units. This gives structure to various parts of information and makes them much easier to handle. Thirdly, representational transformation helps in the process of suppressing irrelevant information and unnecessary elements of problems. This is a key step in organizing and structuring information. Fourthly, representational transformation helps in the process of discovering general rules and turning them into explicit knowledge. (shrink)

Cognitive Science, Volume 46, Issue 2, February 2022.

Height-pitch associations are claimed to be universal and independent of language, but this claim remains controversial. The present study sheds new light on this debate with a multimodal analysis of individual sound and melody descriptions obtained in an interactive communication paradigm with speakers of Dutch and Farsi. The findings reveal that, in contrast to Dutch speakers, Farsi speakers do not use a height-pitch metaphor consistently in speech. Both Dutch and Farsi speakers’ co-speech gestures did reveal a mapping of higher pitches (...) to higher space and lower pitches to lower space, and this gesture space-pitch mapping tended to co-occur with corresponding spatial words (high-low). However, this mapping was much weaker in Farsi speakers than Dutch speakers. This suggests that cross-linguistic differences shape the conceptualization of pitch and further calls into question the universality of height-pitch associations. (shrink)

What is the role of language in constructing knowledge? In this article, we ask whether learning new relational language can create new ways of thinking. In Experiment 1, we taught English speakers to talk about time using new vertical linguistic metaphors, saying things like “breakfast is above dinner” or “breakfast is below dinner”. In Experiment 2, rather than teaching people new metaphors, we relied on the left–right representations of time that our American college student participants have already internalized through a (...) lifetime of visuospatial experience reading and writing text from left to right. In both experiments, we asked whether the representations are susceptible to verbal interference. We found that learning new metaphors created new space–time associations that could be detected in a nonlinguistic implicit association task; these newly learned representations were not susceptible to verbal interference; and with respect to both verbal and visual interference, representations newly learned from linguistic metaphor behaved just like those on the left–right axis that our participants had acquired through years of visuospatial experience. Taken together, these results suggest that learning new relational language can be a powerful tool in constructing new representations and expanding our cognitive repertoire. (shrink)

Languages around the world use a recurring strategy to discuss abstract concepts: describe them metaphorically, borrowing language from more concrete domains. We “plan ahead” to the future, “count up” to higher numbers, and “warm” to new friends. Past work has found that these ways of talking have implications for how we think, so that shared systems of linguistic metaphors can produce shared conceptualizations. On the other hand, these systematic linguistic metaphors might not just be the cause but also the effect (...) of shared, non‐linguistic ways of thinking. Here, we present a case study of a variety of American English in which a shared, non‐linguistic conceptualization of time has become crystallized as a new system of linguistic metaphors. Speakers of various languages, including English, conceptualize time as a lateral timeline, with the past leftward and the future rightward. Until now, this conceptualization has not been documented in the speech of any language. In two studies, we document how members of the U.S. military, but not U.S. civilians, talk about time using conventionalized lateral metaphors (e.g., “move the meeting right” to mean “move the meeting later”). We argue that, under the right cultural circumstances, implicit mental representations become conventionalized metaphors in language. (shrink)

The temporal‐focus hypothesis claims that whether people conceptualize the past or the future as in front of them depends on their cultural attitudes toward time; such conceptualizations can be independent from the space–time metaphors expressed through language. In this paper, we study how Chinese people conceptualize time on the sagittal axis to find out the respective influences of language and culture on mental space–time mappings. An examination of Mandarin speakers' co‐speech gestures shows that some Chinese spontaneously perform past‐in‐front/future‐at‐back (besides future‐in‐front/past‐at‐back) (...) gestures, especially when gestures are accompanying past‐in‐front/future‐at‐back space–time metaphors (Exp. 1). Using a temporal performance task, the study confirms that Chinese can conceptualize the future as behind and the past as in front of them, and that such space–time mappings are affected by the different expressions of Mandarin space–time metaphors (Exp. 2). Additionally, a survey on cultural attitudes toward time shows that Chinese tend to focus slightly more on the future than on the past (Exp. 3). Within the Chinese sample, we did not find evidence for the effect of participants' cultural temporal attitudes on space–time mappings, but a cross‐cultural comparison of space–time mappings between Chinese, Moroccans, and Spaniards provides strong support for the temporal‐focus hypothesis. Furthermore, the results of Exp. 2 are replicated even after controlling for factors such as cultural temporal attitudes and age (Exp. 3), which implies that linguistic sagittal temporal metaphors can indeed influence Mandarin speakers' space–time mappings. The findings not only contribute to a better understanding of Chinese people's sagittal temporal orientation, but also have additional implications for theories on the mental space–time mappings and the relationship between language and thought. (shrink)

Alongside significant gains in our understanding of the human mind, research in Cognitive Science has produced substantial evidence that the details of cognitive processes vary across cultures, contexts, and individuals. In order to arrive at a more nuanced account of the workings of the human mind, in this letter we argue that one challenge for the future of Cognitive Science is the integration of this evidence of variation with findings which can be generalized.

Human languages typically employ a variety of spatial metaphors for time (e.g., “I'm looking forward to the weekend”). The metaphorical grounding of time in space is also evident in gesture. The gestures that are performed when talking about time bolster the view that people sometimes think about regions of time as if they were locations in space. However, almost nothing is known about the development of metaphorical gestures for time, despite keen interest in the origins of space–time metaphors. In this (...) study, we examined the gestures that English‐speaking 6‐to‐7‐year‐olds, 9‐to‐11‐year‐olds, 13‐to‐15‐year‐olds, and adults produced when talking about time. Participants were asked to explain the difference between pairs of temporal adverbs (e.g., “tomorrow” versus “yesterday”) and to use their hands while doing so. There was a gradual increase across age groups in the propensity to produce spatial metaphorical gestures when talking about time. However, even a substantial majority of 6‐to‐7‐year‐old children produced a spatial gesture on at least one occasion. Overall, participants produced fewer gestures in the sagittal (front‐back) axis than in the lateral (left‐right) axis, and this was particularly true for the youngest children and adolescents. Gestures that were incongruent with the prevailing norms of space–time mappings among English speakers (leftward and backward for past; rightward and forward for future) gradually decreased with increasing age. This was true for both the lateral and sagittal axis. This study highlights the importance of metaphoricity in children's understanding of time. It also suggests that, by 6 to 7 years of age, culturally determined representations of time have a strong influence on children's spatial metaphorical gestures. (shrink)

This paper is a comparative study based on the linguistic evidence in Vedic Sanskrit and Homeric Greek, aimed at reconstructing the space-time cognitive models used in the Proto-Indo-European language in a diachronic perspective. While it has been widely recognized that ancient Indo-European languages construed earlier events as in front of later ones, as predicted in the Time-Reference-Point mapping, it is less clear how in the same languages the passage took place from this ‘archaic’ Time-RP model or non-deictic sequence, in which (...) future events are behind or follow the past ones in a temporal sequence, to the more recent ‘post-archaic’ Ego-RP model that is found only from the classical period onwards, in which the future is located in front and the past in back of a deictic observer. Data from the Rigveda and the Homeric poems show that an Ego-RP mapping with an ego-perspective frame of reference could not have existed yet at an early Indo-European stage. In particular, spatial terms of front and behind turn out to be used with reference not only to temporal events, but also to east and west respectively, thus presupposing the existence of an absolute field-based FoR which the temporal sequence is metaphorically related to. Specifically, sequence is relative position on a path appears to be motivated by what has been called day orientation frame, in which the different positions of the sun during the day motivate the mapping of front onto ‘earlier’ and behind onto ‘later’, without involving ego’s ‘now’. These findings suggest that early Indo-European still had not made use of spatio-temporal deixis based on the tense-related ego-perspective FoR found in modern languages. (shrink)

concepts cannot be directly perceived through senses. How do people represent abstract concepts in their minds? According to the Conceptual Metaphor Theory, people tend to rely on concrete experiences to understand abstract concepts. For instance, cognitive science has shown that time is a metaphorically constituted conception, understood relative to concepts like space. Across many languages, the “past” is associated with the “back” and the “future” is associated with the “front”. However, space-time mappings in people’s spoken metaphors are not always consistent (...) with the implicit mental metaphors they are using to conceptualize time in their minds, suggesting a dissociation between temporal language and temporal thought. Beyond the influences of language, the Temporal Focus Hypothesis proposes that people’s spatial conceptions of time are shaped by their attentional focus on temporal events. In general, people conceptualize the past as being in front to the extent that their culture is past-oriented, and the future as being in front to the extent that their culture is future-oriented. Recent lines of research have provided preliminary evidence that people’s implicit space-time mappings are malleable and likely result from multiple factors related to temporal focus, ranging from those relating to contextual features, such as cultural attitudes toward time, to those more tightly tied to the individual, such as age-related differences. By building upon and extending these findings, the overall aim of this thesis is to ascertain the generalizability of the Temporal Focus Hypothesis and further investigate the range of factors that may influence people’s spatializations of time, focusing specifically on previously unexplored within-cultural differences, political ideology, religion, real life experiences, pregnancy, temporal landmarks, circadian rhythms and chronotype, and personality. Together, these studies demonstrate that people’s implicit space-time mappings may vary according to their temporal focus, which can be explained by the Temporal Focus Hypothesis. The findings of these studies also shed new light on the Temporal Focus Hypothesis by extending the range of factors that may influence people’s conceptions of time, and reveal the malleability and flexibility of time representations. (shrink)