Visual Form and Event Semantics Predict Transitivity in Silent Gestures: Evidence for Compositionality

Cognitive Science 47 (8):e13331 (2023)
  Copy   BIBTEX

Abstract

Silent gesture is not considered to be linguistic, on par with spoken and sign languages. It is claimed that silent gestures, unlike language, represent events holistically, without compositional structure. However, recent research has demonstrated that gesturers use consistent strategies when representing objects and events, and that there are behavioral and clinically relevant limits on what form a gesture may take to effect a particular meaning. This systematicity challenges a holistic interpretation of silent gesture, which predicts that there should be no stable form‐meaning correspondence across event representations. Here, we demonstrate to the contrary that untrained gesturers systematically manipulate the form of their gestures when representing events with and without a theme (e.g., Someone popped the balloon vs. Someone walked), that is, transitive and intransitive events. We elicited silent gestures and annotated them for manual features active in coding transitivity distinctions in sign languages. We trained linear support vector machines to make item‐by‐item transitivity predictions based on these features. Prediction accuracy was good across the entire dataset, thus demonstrating that systematicity in silent gesture can be explained with recourse to subunits. We argue that handshape features are constructs co‐opted from cognitive systems subserving manual action production and comprehension for communicative purposes, which may integrate into the linguistic system of emerging sign languages. We further suggest that nonsigners tend to map event participants to each hand, a strategy found across genetically and geographically distinct sign languages, suggesting the strategy's cognitive foundation.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 91,897

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Direct compositionality.Chris Barker & Pauline I. Jacobson (eds.) - 2007 - New York: Oxford University Press.
Compositionality in Davidson’s Early Work.Peter Pagin - 2019 - Journal for the History of Analytical Philosophy 7 (2):76-89.
Coordination Within Language.Kit Fine - 2007 - In Semantic Relationism. Ames, Iowa, USA: Blackwell. pp. 33–65.
Compositionality, Computability, and Complexity.Peter Pagin - 2021 - Review of Symbolic Logic 14 (3):551-591.
Compositionality.Peter Pagin & Dag Westerståhl - 2011 - In Klaus von Heusinger, Claudia Maienborn & Paul Portner (eds.), Semantics: An International Handbook of Natural Language Meaning. Berlin, Germany: De Gruyter. pp. 96-123.

Analytics

Added to PP
2023-08-29

Downloads
11 (#1,137,899)

6 months
9 (#308,527)

Historical graph of downloads
How can I increase my downloads?