The Interplay Between Gesture and Speech in the Production of Referring Expressions: Investigating the Tradeoff Hypothesis

Topics in Cognitive Science 4 (2):232-248 (2012)
  Copy   BIBTEX

Abstract

The tradeoff hypothesis in the speech–gesture relationship claims that (a) when gesturing gets harder, speakers will rely relatively more on speech, and (b) when speaking gets harder, speakers will rely relatively more on gestures. We tested the second part of this hypothesis in an experimental collaborative referring paradigm where pairs of participants (directors and matchers) identified targets to each other from an array visible to both of them. We manipulated two factors known to affect the difficulty of speaking to assess their effects on the gesture rate per 100 words. The first factor, codability, is the ease with which targets can be described. The second factor, repetition, is whether the targets are old or new (having been already described once or twice). We also manipulated a third factor, mutual visibility, because it is known to affect the rate and type of gesture produced. None of the manipulations systematically affected the gesture rate. Our data are thus mostly inconsistent with the tradeoff hypothesis. However, the gesture rate was sensitive to concurrent features of referring expressions, suggesting that gesture parallels aspects of speech. We argue that the redundancy between speech and gesture is communicatively motivated

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 91,219

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Language as Gesture: Merleau-Ponty and American Sign Language.Jerry H. Gill - 2010 - International Philosophical Quarterly 50 (1):25-37.
Gesture and Thought.David McNeill - 2005 - University of Chicago Press.
Gesture-first, but no gestures?David McNeill, Bennett Bertenthal, Jonathan Cole & Shaun Gallagher - 2005 - Behavioral and Brain Sciences 28 (2):138-139.

Analytics

Added to PP
2012-03-03

Downloads
181 (#104,260)

6 months
8 (#292,366)

Historical graph of downloads
How can I increase my downloads?

Author's Profile

Jan de Ruiter
Tufts University