When two or more people coordinate their actions in space and time to produce a joint outcome, they perform a joint action. The perceptual, cognitive, and motor processes that enable individuals to coordinate their actions with others have been receiving increasing attention during the last decade, complementing earlier work on shared intentionality and discourse. This chapter reviews current theoretical concepts and empirical findings in order to provide a structured overview of the state of the art in joint action research. We (...) distinguish between planned and emergent coordination. In planned coordination, agents' behavior is driven by representations that specify the desired outcomes of joint action and the agent's own part in achieving these outcomes. In emergent coordination, coordinated behavior occurs due to perception action couplings that make multiple individuals act in similar ways, independently of joint plans. We review evidence for the two types of coordination and discuss potential synergies between them. (shrink)

This volume will be an invaluable guide for student and professional researchers in visual perception, cognitive psychology, and cognitive neuroscience.

Prior research suggests that the action system is responsible for creating an immediate sense of self by determining whether certain sensations and perceptions are the result of one's own actions. In addition, it is assumed that declarative, episodic, or autobiographical memories create a temporally extended sense of self or some form of identity. In the present article, we review recent evidence suggesting that action (procedural) knowledge also forms part of a person's identity, an action identity, so to speak. Experiments that (...) addressed self-recognition of past actions, prediction, and coordination provide ample evidence for this assumption. The phenomena observed in these experiments can be explained by the assumption that observing an action results in the activation of action representations, the more so, when the action observed corresponds to the way in which the observer would produce it. (shrink)

Ensemble musicians play in synchrony despite expressively motivated irregularities in timing. We hypothesized that synchrony is achieved by each performer internally simulating the concurrent actions of other ensemble members, relying initially on how they would perform in their stead. Hence, musicians should be better at synchronizing with recordings of their own earlier performances than with others’ recordings. We required pianists to record one part from each of several piano duets, and later to play the complementary part in synchrony with their (...) own or others’ recordings. The pianists were also asked to identify their own recordings. The pianists were better at synchronizing with their own than with others’ performances, and they were able to recognize their own recordings. Furthermore, synchronization accuracy and recognition were correlated: Pianists who were relatively accurate at synchronizing with their own performances were also good at recognizing them. Thus, action simulation may underlie both synchronization and self-recognition. (shrink)

The self seems to be a unitary entity remaining stable across time. Nevertheless, current theorizing conceptualizes the self as a number of interacting sub-systems involving perception, intention and action (self-model). One important function of such a self-model is to distinguish between events occurring as a result of one's own actions and events occurring as the result of somebody else's actions. We conducted an fMRI experiment that compared brain activation after an abrupt mismatch between one's own movement and its visual consequences (...) with an abrupt mismatch between one's own movement and somebody else's visually perceived hand movement. A right fronto-parietal network was selectively active during a sudden mismatch between one's own observed and performed hand action. (shrink)

Drawing on recent findings in the cognitive and neurosciences, this article discusses how people manage to predict each other’s actions, which is fundamental for joint action. We explore how a common coding of perceived and performed actions may allow actors to predict the what, when, and where of others’ actions. The “what” aspect refers to predictions about the kind of action the other will perform and to the intention that drives the action. The “when” aspect is critical for all joint (...) actions requiring close temporal coordination. The “where” aspect is important for the online coordination of actions because actors need to effectively distribute a common space. We argue that although common coding of perceived and performed actions alone is not sufficient to enable one to engage in joint action, it provides a representational platform for integrating the actions of self and other. The final part of the paper considers links between lower‐level processes like action simulation and higher‐level processes like verbal communication and mental state attribution that have previously been at the focus of joint action research. (shrink)

The self seems to be a unitary entity remaining stable across time. Nevertheless, current theorizing conceptualizes the self as a number of interacting sub-systems involving perception, intention and action (self-model). One important function of such a self-model is to distinguish between events occurring as a result of one's own actions and events occurring as the result of somebody else's actions. We conducted an fMRI experiment that compared brain activation after an abrupt mismatch between one's own movement and its visual consequences (...) with an abrupt mismatch between one's own movement and somebody else's visually perceived hand movement. A right fronto-parietal network was selectively active during a sudden mismatch between one's own observed and performed hand action. (shrink)

The core of human cooperation is people's ability to perform joint actions. Frequently, this requires effectively decomposing a joint task into individual subtasks, for example, when jointly shopping at the market to buy food. Surprisingly, little is known about how collaborators balance the costs of establishing a joint strategy for such decompositions and its expected benefits for a joint goal. We created a new online task that required pairs of randomly matched participants to jointly collect colored items. We then systematically (...) varied the cognitive costs and benefits of applying a color‐splitting strategy. The results showed that pairs adopted a color‐splitting strategy more often when necessary to lower cognitive costs. However, once the strategy was jointly adopted, it continued to be used even when the cost–benefits changed. Our results provide first insights on how people decompose joint tasks into individual components and how decomposition strategies may evolve into conventions. (shrink)

Communication is not just about the transfer of verbal information. Gestures, facial expressions, intonation and body language are all major sources of information during conversation. This book presents a new perspective on communication, one that will help us to better understand humans, and also to build machines that can communicate.

Imitation research has focused on turn‐taking contexts in which one person acts and one person then copies that action. However, people also imitate when engaging in joint actions, where two or more people coordinate their actions in space and time in order to achieve a shared goal. We discuss how the various constraints imposed by joint action modulate imitation, and the close links between perception and action that form the basis of this phenomenon. We also explore how understanding imitation in (...) the context of joint action yields new insights into cultural phenomena such as teaching and innovation. (shrink)

An action-oriented perspective changes the role of an individual from a passive observer to an actively engaged agent interacting in a closed loop with the world as well as with others. Cognition exists to serve action within a landscape that contains both. This chapter surveys this landscape and addresses the status of the pragmatic turn. Its potential influence on science and the study of cognition are considered (including perception, social cognition, social interaction, sensorimotor entrainment, and language acquisition) and its impact (...) on how neuroscience is studied is also investigated (with the notion that brains do not passively build models, but instead support the guidance of action). A review of its implications in robotics and engineering includes a discussion of the application of enactive control principles to couple action and perception in robotics as well as the conceptualization of system design in a more holistic, less modular manner. Practical applications that can impact the human condition are reviewed (e.g., educational applications, treatment possibilities for developmental and psychopathological disorders, the development of neural prostheses). All of this foreshadows the potential societal implications of the pragmatic turn. The chapter concludes that an action-oriented approach emphasizes a continuum of interaction between technical aspects of cognitive systems and robotics, biology, psychology, the social sciences, and the humanities, where the individual is part of a grounded cultural system. (shrink)

The sense of agency has received much attention in the context of individual action but not in the context of joint action. We investigated how the sense of agency developed during individual and dyadic performance while people learned a haptic coordination task. The sense of agency increased with better performance in all groups. Individuals and dyads showed a differential sense of agency after initial task learning, with dyads showing a minimal increase. The sense of agency depended on the context in (...) which the task was first learnt, as transfer from joint to individual performance resulted in an illusory boost in the sense of agency. Whereas the quality of performance related to the sense of agency, the generated forces to achieve the task did not. Our findings are consistent with a predictive model account at the perceptual level, such that the sense of agency relies most strongly on sharable perceptual information. (shrink)

The “self” shapes the way in which we process the world around us. It makes sense then, that self-related information is reliably prioritised over non self-related information in cognition. How mig...

In the absence of pre‐established communicative conventions, people create novel communication systems to successfully coordinate their actions toward a joint goal. In this study, we address two types of such novel communication systems: sensorimotor communication, where the kinematics of instrumental actions are systematically modulated, versus symbolic communication. We ask which of the two systems co‐actors preferentially create when aiming to communicate about hidden object properties such as weight. The results of three experiments consistently show that actors who knew the weight (...) of an object transmitted this weight information to their uninformed co‐actors by systematically modulating their instrumental actions, grasping objects of particular weights at particular heights. This preference for sensorimotor communication was reduced in a fourth experiment where co‐actors could communicate with weight‐related symbols. Our findings demonstrate that the use of sensorimotor communication extends beyond the communication of spatial locations to non‐spatial, hidden object properties. (shrink)

Cognitive science is experiencing a pragmatic turn away from the traditional representation-centered framework toward a view that focuses on understanding cognition as "enactive." This enactive view holds that cognition does not produce models of the world but rather subserves action as it is grounded in sensorimotor skills. In this volume, experts from cognitive science, neuroscience, psychology, robotics, and philosophy of mind assess the foundations and implications of a novel action-oriented view of cognition. Their contributions and supporting experimental evidence show that (...) an enactive approach to cognitive science enables strong conceptual advances, and the chapters explore key concepts for this new model of cognition. The contributors discuss the implications of an enactive approach for cognitive development; action-oriented models of cognitive processing; action-oriented understandings of consciousness and experience; and the accompanying paradigm shifts in the fields of philosophy, brain science, robotics, and psychology. ContributorsMoshe Bar, Lawrence W. Barsalov, Olaf Blanke, Jeannette Bohg, Martin V. Butz, Peter F. Dominey, Andreas K. Engel, Judith M. Ford, Karl J. Friston, Chris D. Frith, Shaun Gallagher, Antonia Hamilton, Tobias Heed, Cecilia Heyes, Elisabeth Hill, Matej Hoffmann, Jakob Hohwy, Bernhard Hommel, Atsushi Iriki, Pierre Jacob, Henrik Jörntell, Jürgen Jost, James Kilner, Günther Knoblich, Peter König, Danica Kragic, Miriam Kyselo, Alexander Maye, Marek McGann, Richard Menary, Thomas Metzinger, Ezequiel Morsella, Saskia Nagel, Kevin J. O'Regan, Pierre-Yves Oudeyer, Giovanni Pezzulo, Tony J. Prescott, Wolfgang Prinz, Friedemann Pulvermüller, Robert Rupert, Marti Sanchez-Fibla, Andrew Schwartz, Anil K. Seth, Vicky Southgate, Antonella Tramacere, John K. Tsotsos, Paul F. M. J. Verschure, Gabriella Vigliocco, Gottfried Vosgerau. (shrink)