Our earliest tools are our bodies. Our hands raise and turn and toss and carry and push and pull, our legs walk and climb and kick allowing us to move and act in the world and to create the multitude of artifacts that improve our lives. The list of actions made by our hands and feet and other parts of our bodies is long. What is more remarkable is we turn those actions in the world into actions on thought through (...) gestures, language, and graphics, thereby creating cognitive tools that expand the mind. The focus here is gesture; gestures transform actions on perceptible objects to actions on imagined thoughts, carrying meaning with them rapidly, precisely, and directly. We review evidence showing that gestures enhance our own thinking and change the thought of others. We illustrate the power of gestures in studies showing that gestures uniquely change conceptions of time, from sequential to simultaneous, from sequential to cyclical, and from a perspective embedded in a timeline to an external perspective looking on a timeline, and by so doing obviate the ambiguities of an embedded perspective. We draw parallels between representations in gesture and in graphics; both use marks or actions arrayed in space to communicate more immediately than symbolic language. (shrink)

In order to produce a coherent narrative, speakers must identify the characters in the tale so that listeners can figure out who is doing what to whom. This paper explores whether speakers use gesture, as well as speech, for this purpose. English speakers were shown vignettes of two stories and asked to retell the stories to an experimenter. Their speech and gestures were transcribed and coded for referent identification. A gesture was considered to identify a referent if it was produced (...) in the same location as the previous gesture for that referent. We found that speakers frequently used gesture location to identify referents. Interestingly, however, they used gesture most often to identify referents that were also uniquely specified in speech. Lexical specificity in referential expressions in speech thus appears to go hand‐in‐hand with specification in referential expressions in gesture. (shrink)

Two standard epistemological accounts are conflated in Dienes & Perner's account of knowledge, and this conflation requires the rejection of their four conditions of knowledge. Because their four metarepresentations applied to the explicit-implicit distinction are paired with these conditions, it follows by modus tollens that if the latter are inadequate, then so are the former. Quite simply, their account misses the link between true reasoning and knowledge.

In this article, we propose that gestures play an important role in the connection between sensorimotor experience and language. Gestures may be the link between bodily experience and verbal expression that advocates of embodied cognition have postulated. In a developmental sequence of communicative action, gestures, which are initially similar to action sequences, substantially shorten and represent actions in metonymic form. In another process, action sequences are based on kinesthetic schemata that themselves find their metaphoric expression in language. Again, gestures enact (...) kinesthetic schemata that are correlated with verbal expressions. Examples from a large database are used to illustrate the various processes by means of which language arises when students conduct school science investigations. (shrink)

This study investigated the roles of problem structure and strategy use in problem encoding. Fourth‐grade students solved and explained a set of typical addition problems (e.g., 5 + 4 + 9 + 5 = _) and mathematical equivalence problems (e.g., 4 + 3 + 6 = 4 + _ or 6 + 4 + 5 = _ + 5). Next, they completed an encoding task in which they reconstructed addition and equivalence problems after viewing each for 5 s. Equivalence problems (...) of the form 4 + 3 + 6 = 4 + _ overlap with a perceptual pattern found in traditional arithmetic problems (i.e., answer blank in final position), and students' encoding was poorest on problems of this type. Individual differences in encoding the equivalence problems were related to variations in strategy use. Some students solved blank‐final equivalence problems using the standard arithmetic strategy of performing all given operations on all given numbers. These students made more errors in encoding problem structure, but fewer errors in encoding the numbers, than did students who solved the problems using correct or other incorrect strategies. Moreover, students who expressed many strategies for solving the blank‐final equivalence problems made fewer errors in encoding problem structure, but more errors in encoding the numbers, than did students who expressed only a single strategy. Results highlight that encoding is intended to guide action and that prior experience can simultaneously facilitate and interfere with accurate encoding. (shrink)

This study investigated the roles of problem structure and strategy use in problem encoding. Fourth‐grade students solved and explained a set of typical addition problems (e.g., 5 + 4 + 9 + 5 = _) and mathematical equivalence problems (e.g., 4 + 3 + 6 = 4 + _ or 6 + 4 + 5 = _ + 5). Next, they completed an encoding task in which they reconstructed addition and equivalence problems after viewing each for 5 s. Equivalence problems (...) of the form 4 + 3 + 6 = 4 + _ overlap with a perceptual pattern found in traditional arithmetic problems (i.e., answer blank in final position), and students' encoding was poorest on problems of this type. Individual differences in encoding the equivalence problems were related to variations in strategy use. Some students solved blank‐final equivalence problems using the standard arithmetic strategy of performing all given operations on all given numbers. These students made more errors in encoding problem structure, but fewer errors in encoding the numbers, than did students who solved the problems using correct or other incorrect strategies. Moreover, students who expressed many strategies for solving the blank‐final equivalence problems made fewer errors in encoding problem structure, but more errors in encoding the numbers, than did students who expressed only a single strategy. Results highlight that encoding is intended to guide action and that prior experience can simultaneously facilitate and interfere with accurate encoding. (shrink)

Beyond modularityattempts a synthesis of Fodor's anticonstructivist nativism and Piaget's antinativist constructivism. Contra Fodor, I argue that: (1) the study of cognitive development is essential to cognitive science, (2) the module/central processing dichotomy is too rigid, and (3) the mind does not begin with prespecified modules; rather, development involves a gradual process of “modularization.” Contra Piaget, I argue that: (1) development rarely involves stagelike domain-general change and (2) domainspecific predispositions give development a small but significant kickstart by focusing the infant's (...) attention on proprietary inputs. Development does not stop at efficient learning. A fundamental aspect of human development (“representational redescription”) is the hypothesized process by which information that isina cognitive system becomes progressively explicit knowledgetothat system. Development thus involves two complementary processes of progressive modularization and progressive “explicitation.” Empirical findings on the child as linguist, physicist, mathematician, psychologist, and notator are discussed in support of the theoretical framework. Each chapter concentrates first on the initial state of the infant mind/brain and on subsequent domain-specific learning in infancy and early childhood. It then goes on to explore data on older children's problem solving and theory building, with particular focus on evolving cognitive flexibility. Emphasis is placed throughout on the status of representations underlying different capacities and on the multiple levels at which knowledge is stored and accessible. Finally, consideration is given to the need for more formal developmental models, and a comparison is made between representational redescription and connectionist simulations of development. In conclusion, I consider what is special about human cognition by speculating on the status of representations underlying the structure of behavior in other species. (shrink)

The deep comprehension of a text is tantamount to the construction of an articulated mental model of that text. The number of correct recollections is an index of a learner's mental model of a text. We assume that another index of comprehension is the timing of the gestures produced during text recall; gestures are simultaneous with speech when the learner has built an articulated mental model of the text, whereas they anticipate the speech when the learner has built a less (...) articulated mental model. The results of four experiments confirm the predictions deriving from our assumptions for both children and adults. Provided that the recollections are correct, the timing of gestures can differ and can be considered a further measure of the quality of the mental model, beyond the number of correct recollections. (shrink)

Interactivity has been linked to better performance in problem solving, due in part to a more efficient allocation of attentional resources, a better distribution of cognitive load, but perhaps more important by enabling the reasoner to shape and reshape the physical problem presentation to promote the development of the problem solution. Interactivity in solving quotidian arithmetic problems involves gestures, pointing, and the recruitment of artefacts to facilitate computation and augment efficiency. In the experiment reported here, different types of interactivity were (...) examined with a series of mental arithmetic problems. Using a repeated-measures design, participants solved series of five 11-digit sums in four conditions that varied in the type of interactivity: no interactivity, pointing, pen and paper, and tokens. Performance in the four conditions was measured in terms of accuracy, calculation error, and efficiency. These quantitative analyses were supplemented by a detailed qualitative examination of a participant’s actions in the different conditions. The integration of artefacts, such as tokens or a pen, offered reasoners the opportunity to reconfigure the physical presentation of the problem, enacting different arithmetic strategies: the affordance landscape shifts as the problem trajectory is enacted through interactivity, and this generally produced better “mental” arithmetic performance. Participants also felt more positive about and better engaged with the task when they could reconfigure the problem presentation through interactivity. These findings underscore the importance of engineering task environments in the laboratory that offer a window on how problem solving unfolds through a coalition of mental and physical resources. (shrink)

Children learn and use various strategies to solve math problems. One way children's math learning can be supported is through their use of and exposure to hand gestures. Children's self-produced gestures can reveal unique, math-relevant knowledge that is not contained in their speech. Additionally, these gestures can assist with their math learning and problem solving by supporting their cognitive processes, such as executive function. The gestures that children observe during math instructions are also linked to supporting cognition. Specifically, children are (...) better able to learn, retain, and generalize knowledge about math when that information is presented within the gestures that accompany an instructor's speech. To date, no conceptual model provides an outline regarding how these gestures and the math environment are connected, nor how they may interact with children's underlying cognitive capacities such as their executive function. In this review, we propose a new model based on an integration of the information processing approach and theory of embodied cognition. We provide an in-depth review of the related literature and consider how prior research aligns with each link within the proposed model. Finally, we discuss the utility of the proposed model as it pertains to future research endeavors. (shrink)

When asked to explain their solutions to a problem, both adults and children gesture as they talk. These gestures at times convey information that is not conveyed in speech and thus reveal thoughts that are distinct from those revealed in speech. In this study, we use the classic Tower of Hanoi puzzle to validate the claim that gesture and speech taken together can reflect the activation of two cognitive strategies within a single response. The Tower of Hanoi is a well‐studied (...) puzzle, known to be most efficiently solved by activating subroutines at theoretically defined choice points. When asked to explain how they solved the Tower of Hanoi puzzle, both adults and children produced significantly more gesture‐speech mismatches—explanations in which speech conveyed one path and gesture another—at these theoretically defined choice points than they produced at non‐choice points. Even when the participants did not solve the problem efficiently, gesture could be used to indicate where the participants were deciding between alternative paths. Gesture can, thus, serve as a useful adjunct to speech when attempting to discover cognitive processes in problem‐solving. (shrink)

The implicit-explicit distinction is applied to knowledge representations. Knowledge is taken to be an attitude towards a proposition which is true. The proposition itself predicates a property to some entity. A number of ways in which knowledge can be implicit or explicit emerge. If a higher aspect is known explicitly then each lower one must also be known explicitly. This partial hierarchy reduces the number of ways in which knowledge can be explicit. In the most important type of implicit knowledge, (...) representations merely reflect the property of objects or events without predicating them of any particular entity The dearest cases of explicit knowledge of a fact are representations of one's own attitude of knowing that fact. These distinctions are discussed in their relationship to similar distinctions such as procedural-declarative, conscious unconscious, verbalizable-nonverbalizable, direct-indirect tests, and automatic voluntary control. This is followed by an outline of how these distinctions can be used to integrate and relate the often divergent uses of the implicit-explicit distinction in different research areas. We illustrate this for visual perception, memory, cognitive development, and artificial grammar learning. (shrink)

Gestures and speech are clearly synchronized in many ways. However, previous studies have shown that the semantic similarity between gestures and speech breaks down as people approach transitions in understanding. Explanations for these gesture–speech mismatches, which focus on gestures and speech expressing different cognitive strategies, have been criticized for disregarding gestures’ and speech's integration and synchronization. In the current study, we applied three different perspectives to investigate gesture–speech synchronization in an easy and a difficult task: temporal alignment, semantic similarity, and (...) complexity matching. Participants engaged in a simple cognitive task and were assigned to either an easy or a difficult condition. We automatically measured pointing gestures, and we coded participant's speech, to determine the temporal alignment and semantic similarity between gestures and speech. Multifractal detrended fluctuation analysis was used to determine the extent of complexity matching between gestures and speech. We found that task difficulty indeed influenced gesture–speech synchronization in all three domains. We thereby extended the phenomenon of gesture–speech mismatches to difficult tasks in general. Furthermore, we investigated how temporal alignment, semantic similarity, and complexity matching were related in each condition, and how they predicted participants’ task performance. Our study illustrates how combining multiple perspectives, originating from different research areas (i.e., coordination dynamics, complexity science, cognitive psychology), provides novel understanding about cognitive concepts in general and about gesture–speech synchronization and task difficulty in particular. (shrink)

When people talk, they gesture. Gesture is a fundamental component of language that contributes meaningful and unique information to a spoken message and reflects the speaker’s underlying knowledge and experiences. Theoretical perspectives of speech and gesture propose that they share a common conceptual origin and have a tightly integrated relationship, overlapping in time, meaning, and function to enrich the communicative context. We review a robust literature from the field of psychology documenting the benefits of gesture for communication for both speakers (...) and listeners, as well as its important cognitive functions for organizing spoken language, and facilitating problem-solving, learning, and memory. Despite this evidence, gesture has been relatively understudied in populations with neurogenic communication disorders. While few studies have examined the rehabilitative potential of gesture in these populations, others have ignored gesture entirely or even discouraged its use. We review the literature characterizing gesture production and its role in intervention for people with aphasia, as well as describe the much sparser literature on gesture in cognitive communication disorders including right hemisphere damage, traumatic brain injury, and Alzheimer’s disease. The neuroanatomical and behavioral profiles of these patient populations provide a unique opportunity to test theories of the relationship of speech and gesture and advance our understanding of their neural correlates. This review highlights several gaps in the field of communication disorders which may serve as a bridge for applying the psychological literature of gesture to the study of language disorders. Such future work would benefit from considering theoretical perspectives of gesture and using more rigorous and quantitative empirical methods in its approaches. We discuss implications for leveraging gesture to explore its untapped potential in understanding and rehabilitating neurogenic communication disorders. (shrink)

We focus on Karmiloff-Smith's Representational redescription model, arguing that it poses some problems concerning the architecture of a redescribing system. To discuss the topic, we consider the implicit/explicit dichotomy and the relations between natur al language and the language of thought. We argue that the model regards how knowledge is employed rather than how it is represented in the system.