Speakers of different languages (e.g., English vs. Turkish) show a binary split in how they package and order components of a motion event in speech and co‐speech gesture but not in silent gesture. In this study, we focused on Mandarin Chinese, a language that does not follow the binary split in its expression of motion in speech, and asked whether adult Chinese speakers would follow the language‐specific speech patterns in co‐speech but not silent gesture, thus showing a pattern akin to (...) Turkish and English adult speakers in their description of animated motion events. Our results provided evidence for this pattern, with Chinese—as well as English and Turkish—speakers following language‐specific patterns in speech and co‐speech gesture but not in silent gesture. Our results provide support for the “thinking‐for‐speaking” account, namely that language influences thought only during online, but not offline, production of speech. (shrink)

Cognitive Science, Volume 46, Issue 5, May 2022.

Pantomime has long been considered distinct from co-speech gesture. It has therefore been argued that pantomime cannot be part of gesture-speech integration. We examine pantomime as distinct from silent gesture, focusing on non-co-speech gestures that occur in the midst of children’s spoken narratives. We propose that gestures with features of pantomime are an infrequent but meaningful component of a multimodal communicative strategy. We examined spontaneous non-co-speech representational gesture production in the narratives of 30 monolingual English-speaking children between the ages of (...) 8- and 11-years. We compared the use of co-speech and non-co-speech gestures in both autobiographical and fictional narratives and examined viewpoint and the use of non-manual articulators, as well as the length of responses and narrative quality. The use of non-co-speech gestures was associated with longer narratives of equal or higher quality than those using only co-speech gestures. Non-co-speech gestures were most likely to adopt character-viewpoint and use non-manual articulators. The present study supports a deeper understanding of the term pantomime and its multimodal use by children in the integration of speech and gesture. (shrink)

The expression of physical motion (the spider crawls across the net) and metaphorical motion (the fear crawls across her heart) shows strong inter-typological differences between language types (German, an S-language vs. Spanish, a V-language) and more subtle intra-typological differences within a language type (German vs. Polish, both S-languages). However, we know relatively less about the extension of these patterns to translated texts. In this study, we focused on physical and metaphorical motion descriptions in written texts in original language and their (...) translations to a language that belongs to the same or a different typological group, to determine whether motion expression in translated texts shows the same patterns of inter-typological and intra-typological variability as it does in original texts. We investigated this question by extracting 450 physical motion (150/language) and 450 metaphorical motion (150/language) descriptions from novels originally written in German, Polish, or Spanish and their translations to typologically different (i.e. inter-typological; German to Spanish, Spanish to German) or typologically similar (i.e. intra-typological; German to Polish, Polish to German) languages. Our results provided evidence for similar patterns of strong inter-typological and more subtle intra-typological variability in translations akin to those observed in original texts – with translated texts largely following the patterns of the target language in their expression of physical and metaphorical motion. Our results also highlighted specificity of event expression in a language as an important factor in the attainment of target language patterns in translated texts. (shrink)

Expression of physical motion (e.g., man runs by) shows systematic variability not only between language types (i.e., inter-typological) but also within a language type (i.e., intra-typological). In this study, we asked whether the patterns of variability extend to metaphorical motion events (e.g., time runs by). Our analysis of randomly selected 450 physical motion (150/language) and 450 metaphorical motion (150/language) event descriptions from written texts originally produced by German, Polish, and Spanish authors showed strong inter-typological differences in the expression of both (...) event types. German and Polish speakers differed from Spanish speakers in how they packaged manner and path components of a motion event; they also differed in how extensively they expressed each component in their lexicalization of motion. The strong inter-typological differences were accompanied by more modest intra-typological variability: Polish and German writers differed in their packaging and lexicalization of manner and path components of metaphorical—but not physical—motion events. Our results provide evidence for robust inter-typological differences evident in the expression of both physical and metaphorical motion, along with less robust intra-typological differences, largely evident in the expression of metaphorical motion. Our study thus highlights event type as an important factor in determining crosslinguistic variation in motion expression. (shrink)

Silent gesture is not considered to be linguistic, on par with spoken and sign languages. It is claimed that silent gestures, unlike language, represent events holistically, without compositional structure. However, recent research has demonstrated that gesturers use consistent strategies when representing objects and events, and that there are behavioral and clinically relevant limits on what form a gesture may take to effect a particular meaning. This systematicity challenges a holistic interpretation of silent gesture, which predicts that there should be no (...) stable form‐meaning correspondence across event representations. Here, we demonstrate to the contrary that untrained gesturers systematically manipulate the form of their gestures when representing events with and without a theme (e.g., Someone popped the balloon vs. Someone walked), that is, transitive and intransitive events. We elicited silent gestures and annotated them for manual features active in coding transitivity distinctions in sign languages. We trained linear support vector machines to make item‐by‐item transitivity predictions based on these features. Prediction accuracy was good across the entire dataset, thus demonstrating that systematicity in silent gesture can be explained with recourse to subunits. We argue that handshape features are constructs co‐opted from cognitive systems subserving manual action production and comprehension for communicative purposes, which may integrate into the linguistic system of emerging sign languages. We further suggest that nonsigners tend to map event participants to each hand, a strategy found across genetically and geographically distinct sign languages, suggesting the strategy's cognitive foundation. (shrink)