People with aphasia use gestures not only to communicate relevant content but also to compensate for their verbal limitations. The Sketch Model (De Ruiter, 2000) assumes a flexible relationship between gesture and speech with the possibility of a compensatory use of the two modalities. In the successor of the Sketch Model, the AR‐Sketch Model (De Ruiter, 2017), the relationship between iconic gestures and speech is no longer assumed to be flexible and compensatory, but instead iconic gestures are assumed to express (...) information that is redundant to speech. In this study, we evaluated the contradictory predictions of the Sketch Model and the AR‐Sketch Model using data collected from people with aphasia as well as a group of people without language impairment. We only found compensatory use of gesture in the people with aphasia, whereas the people without language impairments made very little compensatory use of gestures. Hence, the people with aphasia gestured according to the prediction of the Sketch Model, whereas the people without language impairment did not. We conclude that aphasia fundamentally changes the relationship of gesture and speech. (shrink)

Past research has suggested that those spontaneous movements of the human hand made during talk convey significant semantic information over and above the speech, at least when the unit of speech analyzed is the individual clause. However, no previous research has tested whether this information is represented linguistically elsewhere in the narrative . The first study, reported here, uses an experimental procedure to identify which specific imagistic gestures add semantic information to the speech. The second study analyzes whether the specific (...) gestures still do this when respondents hear the whole narrative. It was found that two thirds of the semantic information, thought to be carried by the gestures, is, in fact, represented in the linguistic discourse, or is inferable from it. However, one third of the additional semantic information contained in the gestures is not represented linguistically in the narrative nor is it inferable from it. In other words, a proportion of the imagistic gestures that accompany speech are absolutely critical to semantic communication. (shrink)

Cognitive Science, Volume 46, Issue 2, February 2022.

Autistic spectrum disorders impair the ability to interact socially. Detecting and understanding their onset is not only an empirical enterprise, but also a theoretical one, often linked to studies on intersubjectivity. Different theoretical perspectives have been elaborated in the past to account for the deficit. The main purpose of this paper is to reinforce and offer empirical grounding to a recent approach, termed Social Orienting Model, by presenting the main theoretical approaches to autism and contrasting them to this view, as (...) well as considering its possible effect on empirical research, focusing on current literature analyzing gestures in children with autism. (shrink)

In this article, we propose that gestures play an important role in the connection between sensorimotor experience and language. Gestures may be the link between bodily experience and verbal expression that advocates of embodied cognition have postulated. In a developmental sequence of communicative action, gestures, which are initially similar to action sequences, substantially shorten and represent actions in metonymic form. In another process, action sequences are based on kinesthetic schemata that themselves find their metaphoric expression in language. Again, gestures enact (...) kinesthetic schemata that are correlated with verbal expressions. Examples from a large database are used to illustrate the various processes by means of which language arises when students conduct school science investigations. (shrink)

The goal of the article is to offer a framework against which relations between gesture and sign can be systematically explored beyond the current literature. It does so by a) reconstructing the history of the discussion in the field of gesture studies, focusing on three leading positions (Kendon, McNeill, Goldin-Meadow); and b) by formulating a position to illustrate how this can be achieved. The paper concludes by emphasizing the need for systematic cross-linguistic research on multimodal use of language in its (...) signed and spoken forms. (shrink)

A review of "Reinterpreting Gesture as Language. Language 'in Action'".