Ensemble musicians play in synchrony despite expressively motivated irregularities in timing. We hypothesized that synchrony is achieved by each performer internally simulating the concurrent actions of other ensemble members, relying initially on how they would perform in their stead. Hence, musicians should be better at synchronizing with recordings of their own earlier performances than with others’ recordings. We required pianists to record one part from each of several piano duets, and later to play the complementary part in synchrony with their (...) own or others’ recordings. The pianists were also asked to identify their own recordings. The pianists were better at synchronizing with their own than with others’ performances, and they were able to recognize their own recordings. Furthermore, synchronization accuracy and recognition were correlated: Pianists who were relatively accurate at synchronizing with their own performances were also good at recognizing them. Thus, action simulation may underlie both synchronization and self-recognition. (shrink)

CHAPTER Simulation theory and mental concepts Alvin I. Goldman Rutgers University. Folk psychology and the TT-ST debate The study of folk psychology, ...

Diverse lines of evidence point to a basic human aversion to physically harming others. First, we demonstrate that unwillingness to endorse harm in a moral dilemma is predicted by individual differences in aversive reactivity, as indexed by peripheral vasoconstriction. Next, we tested the specific factors that elicit the aversive response to harm. Participants performed actions such as discharging a fake gun into the face of the experimenter, fully informed that the actions were pretend and harmless. These simulated harmful actions increased (...) peripheral vasoconstriction significantly more than did witnessing pretend harmful actions or to performing metabolically-matched non-harmful actions. This suggests that the aversion to harmful actions extends beyond empathic concern for victim harm. Together, these studies demonstrate a link between the body and moral decision making processes. (shrink)

Accurately predicting other people's actions may involve two processes: internal real-time simulation (dynamic updating) and matching recently perceived action images (static matching). Using a priming of body parts, this study aimed to differentiate the two processes. Specifically, participants played a motion-controlled video game with either their arms or legs. They then observed arm movements of a point-light actor, which were briefly occluded from view, followed by a static test pose. Participants judged whether this test pose depicted a coherent (...) continuation of the previously seen action (i.e., “action prediction task”). Evidence of dynamic updating was obtained after compatible effector priming (i.e., arms), whereas incompatible effector priming (i.e., legs) indicated static matching. Together, the results support action prediction as engaging two distinct processes, dynamic simulation and static matching, and indicate that their relative contributions depend on contextual factors like compatibility of body parts involved in performed and observed action. (shrink)

Psychological studies (Proffitt, 2006) have demonstrated that what one sees is influenced by one's goals, physiological state, and emotions. These studies demonstrate that there is a positive correlation between the physical demands (energetic cost) and perceived valence (emotional cost) of a task and the appearance of slant and egocentric distance in the environment. The studies are compelling. However, one can question whether their results are due to changes in the way participants perceived the orientation and extent of their environment or (...) are instead artifacts of the way they judged the difficulty of expected tasks in particular contexts. We asked participants to sketch the rough spatial layout of several paintings as accurately as possible. In this type of task participants continuously compare what they have drawn against what they perceive. Therefore, participants performance can be interpreted as a means to directly measure of the spatial metric of perception. We chose two paintings by Andrew Wyeth as target images: “Christina's World” and “Winter, 1946.” Participants were asked to draw the spatial arrangement of the key features of the scene depicted in the target painting twice: prior to being presented with biographical information about the subject of the painting condition; and then again after being told the biographical information that altered the perceived task demands or emotional valence of the events they depicted. We predicted that participants' drawings would differ in the two conditions indicating that: change in the energetic or emotional costs of the depicted action would cause them to perceive the depicted orientation of hills as steeper and distance between key landmarks as longer. Results from the energetic cost condition support this prediction. We will discuss our results and the suggestion that these types of effects reflect a role for motor simulation in perception (Witt, 2005). (shrink)

Business Intelligence can be interpreted as a compensation for the growing complexity of technical support in economic transactions. With the help of sophisticated calculation and analysis tools, the business situation is simplified for the user in order to enable reasonable decisions. However, the simplicity of Business Intelligence is only simulated by hiding the system operations under the surface. This causes a disruption of the general concept of reasonable action. The notion of responsibility disappears between the business expert and the (...) systems engineer. A possible solution to this problem is to change the system design process and to introduce competing technology which could show new traces of the system operation. (shrink)

Control theory is a popular theoretical framework for explaining cognitive domains such as motor control and “mindreading.” Such accounts frequently characterize their “internal models” as “simulating” things outside the brain. But in what sense are these “simulations”? Do they involve the kind of “replication” simulation found in the simulation theory of mindreading? I will argue that some but not all control -theoretic appeals to “simulation” involve R-simulation. To do so, I examine in detail a recent computational (...) model of motor control and action perception based in control theory. I argue that the architecture does not use R-simulation during motor control, but does during action perception. A novel result of this analysis is that the forward model—the control - theoretic mechanism most often described as performing simulation—is not well characterized in terms of R- simulation. I conclude with some lessons for research on the mechanisms of mindreading. (shrink)

It has been proposed that the design of robots might benefit from interactions that are similar to caregiver-child interactions, which is tailored to children's respective capacities to a high degree. However, so far little is known about how people adapt their tutoring behaviour to robots and whether robots can evoke input that is similar to child-directed interaction. The paper presents detailed analyses of speakers' linguistic behaviour and non-linguistic behaviour, such as action demonstration, in two comparable situations: In one experiment, (...) parents described and explained to their nonverbal infants the use of certain everyday objects; in the other experiment, participants tutored a simulated robot on the same objects. The results, which show considerable differences between the two situations on almost all measures, are discussed in the light of the computer-as-social-actor paradigm and the register hypothesis. Keywords: child-directed speech (CDS); motherese; robotese; motionese; register theory; social communication; human-robot interaction (HRI); computers-as-social-actors; mindless transfer. (shrink)

It has been proposed that the design of robots might benefit from interactions that are similar to caregiver–child interactions, which is tailored to children’s respective capacities to a high degree. However, so far little is known about how people adapt their tutoring behaviour to robots and whether robots can evoke input that is similar to child-directed interaction. The paper presents detailed analyses of speakers’ linguistic behaviour and non-linguistic behaviour, such as action demonstration, in two comparable situations: In one experiment, (...) parents described and explained to their nonverbal infants the use of certain everyday objects; in the other experiment, participants tutored a simulated robot on the same objects. The results, which show considerable differences between the two situations on almost all measures, are discussed in the light of the computer-as-social-actor paradigm and the register hypothesis. Keywords: child-directed speech ; motherese; robotese; motionese; register theory; social communication; human–robot interaction ; computers-as-social-actors; mindless transfer. (shrink)

Recent advances in virtual technologies have allowed the investigation of simulated moral actions in aversive moral dilemmas. Previous studies have employed diverse populations in order to explore these actions, with little research considering the significance of occupation on moral decision-making. For the first time, in this study we have investigated simulated moral actions in Virtual Reality made by professionally trained paramedics and fire service incident commanders who are frequently faced with and must respond to moral dilemmas. We found that specially (...) trained individuals showed distinct empathic and related personality trait scores and that these declined with years of experience working in the profession. Supporting the theory that these professionals develop resilience in moral conflict, reduced emotional arousal was observed during virtual simulations of a distressing dilemma. Furthermore, trained professionals demonstrated less regret following the execution of a moral action in virtual reality when compared to untrained control populations. We showed that, contrary to previous research, trained individuals made the same moral judgments and moral actions as untrained individuals, though showing less arousal and regret. In the face of increasing concerns regarding empathy decline in healthcare professionals, we suggest that the nature of this decline is complex and likely reflects the development of a necessary emotional resilience to distressing events. (shrink)

Many philosophers and psychologists argue that out everyday ability to predict and explain the actions and mental states of others is grounded in out possession of a primitive 'folk' psychological theory. Recently however, this theory has come under challenge from the simulation alternative. This alternative view says that human beings are able to predict and explain each other's actions by using the resources of their own minds to simulate the psychological aetiology of the actions of the others. This book (...) and the companion volume Folk Psychology: The Theory of Mind Debate together offer a richly woven fabric of philosophical and psychological theory, which promises to yield real insights into the nature of our mental lives. (shrink)

The theory-theory claims that the explanation and prediction of behavior works via the application of a theory, while the simulation theory claims that explanation works by putting ourselves in others' places and noting what we would do. On either account, in order to develop a prediction or explanation of another person's behavior, one first needs to have a characterization of that person's current or recent actions. Simulation requires that I have some grasp of the other person's behavior to (...) project myself upon; whereas theorizing requires a subject matter to theorize about. The frame problem shows that multiple, true characterizations are possible for any behavior or situation. However, only one or a few of these characterizations are relevant to explaining or predicting behavior. Since different characterizations of a behavior lead to different predictions or explanations, much of the work of interpersonal interpretation is done in the process of finding this characterization - that is, prior to either theorizing or simulating. Moreover, finding this characterization involves extensive knowledge of the physical, cultural, and social worlds of the persons involved. (shrink)

Humans are experts in cooperating with each other when trying to accomplish tasks they cannot achieve alone. Recent studies of joint action have shown that when performing tasks together people strongly rely on the neurocognitive mechanisms that they also use when performing actions individually, that is, they predict the consequences of their co‐actor’s behavior through internal action simulation. Context‐sensitive action monitoring and action selection processes, however, are relatively underrated but crucial ingredients of joint action. (...) In the present paper, we try to correct the somewhat simplified view on joint action by reviewing recent studies of joint action simulation, monitoring, and selection while emphasizing the intricate interrelationships between these processes. We complement our review by defining the contours of a neurologically plausible computational framework of joint action. (shrink)

This paper is concerned with the problem of selfidentification in the domain of action. We claim that this problem can arise not just for the self as object, but also for the self as subject in the ascription of agency. We discuss and evaluate some proposals concerning the mechanisms involved in selfidentification and in agencyascription, and their possible impairments in pathological cases. We argue in favor of a simulation hypothesis that claims that actions, whether overt or covert, are (...) centrally simulated by the neural network, and that this simulation provides the basis for action recognition and attribution. (shrink)

Motor imagery typically involves an experience as of moving a body part. Recent studies reveal close parallels between the constraints on motor imagery and those on actual motor performance. How are these parallels to be explained? We advance a simulative theory of motor imagery, modeled on the idea that we predict and explain the decisions of others by simulating their decision-making processes. By proposing that motor imagery is essentially off-line motor action, we explain the tendency of motor imagery to (...) mimic motor performance. We close by arguing that a simulative theory of motor imagery gives (modest) support to and illumination of the simulative theory of decision-prediction. (shrink)

A program for the simulation of rational social normative trust, predictive `trust,' and predictive reliance between agents will be introduced. It offers a tool for social scientists or a trust component for multi-agent simulations/multi-agent systems, which need to include trust between agents to guide the decisions about the course of action. It is based on an analysis of rational social normative trust (RSNTR) (revised version of M. Tuomela 2002), which is presented and briefly argued. For collective agents, belief (...) conditions for collective agency should be added. For the various forms of trust agents must have (at least) subjectively rational reasons to believe that the conditions of the trust account are fulfilled. A list of such reasons (of varied weights), e.g., given by empirical research, can manually be built into a parameter file or be generated by a calling program in a fixed format. From this list of reasons the program randomly generates a belief base for the agents of the artificial society. Reasons can be chained together so that one set of reasons satisfies several belief conditions. The program checks if the conditions are fulfilled for the artificial agents' social normative trust/predictive `trust'/`predictive reliance' in another agent that he will perform an action X. Each outcome is logged to a result file. In conclusion we discuss various aspects of the application of a trust component of the suggested kind in empirical research, social simulation, and multi-agent systems. (shrink)

Drawing on recent findings in the cognitive and neurosciences, this article discusses how people manage to predict each other’s actions, which is fundamental for joint action. We explore how a common coding of perceived and performed actions may allow actors to predict the what, when, and where of others’ actions. The “what” aspect refers to predictions about the kind of action the other will perform and to the intention that drives the action. The “when” aspect is critical (...) for all joint actions requiring close temporal coordination. The “where” aspect is important for the online coordination of actions because actors need to effectively distribute a common space. We argue that although common coding of perceived and performed actions alone is not sufficient to enable one to engage in joint action, it provides a representational platform for integrating the actions of self and other. The final part of the paper considers links between lower‐level processes like action simulation and higher‐level processes like verbal communication and mental state attribution that have previously been at the focus of joint action research. (shrink)

There is much disagreement about how extensive a role theoretical mind-reading, behavior-reading, and simulation each have and need to have in our knowing and understanding other minds, and how each method is implemented in the brain, but less discussion of the epistemological question what it is about the products of these methods that makes them count as knowledge or understanding. This question has become especially salient recently as some have the intuition that mirror neurons can bring understanding of another's (...) action despite involving no higher-order processing, whereas most epistemologists writing about understanding think that it requires reflective access to one's grounds, which is closer to the intuitions of other commenters on mirror neurons. I offer a definition of what it is that makes something understanding that is compelling independently of the context of cognition of other minds, and use it to show two things: 1) that theoretical mind-reading and simulation bring understanding in virtue of the same epistemic feature, and 2) why the kind of motor representation without propositional attitudes that is done by mirror neurons is sufficient for action understanding. I further suggest that more attention should be paid to the potential disadvantages of a simulative method of knowing. Though it can be more efficient in some cases, it can also bring vulnerability, wear and tear on one's personal equipment, and unintended mimicry. (shrink)

In this article, I argue that a capacity for mindreading conceived along the line of simulation theory provides the cognitive basis for forming we-centric representations of actions and goals. This explains the plural first personal stance displayed by we-intentions in terms of the underlying cognitive processes performed by individual minds, while preserving the idea that they cannot be analyzed in terms of individual intentional states. The implication for social ontology is that this makes sense of the plural subjectivity of (...) joint actions without making group agents require either a corporate body or the unity of consciousness. (shrink)

Simulation has emerged as an increasingly popular account of folk psychological (FP) talents at mind-reading: predicting and explaining human mental states. Where its rival (the theory-theory) postulates that these abilities are explained by mastery of laws describing the connections between beliefs, desires, and action, simulation theory proposes that we mind-read by "putting ourselves in another's shoes." This paper concerns connectionist architecture and the debate between simulation theory (ST) and the theory-theory (TT). It is only natural to (...) associate TT with classical architectures where rule governed operations apply to explicit propositional representations. On the other hand, ST would seem better tuned to procedurally oriented non-symbolic structures found in connectionist models. This paper explores the possible alignment between ST and connectionist architecture. Joe Cruz argues that connectionist models with distributed non-symbolic representations are particularly well suited to simulation theory. The purported linkage between connectionist architecture and simulation theory is criticized in this paper. The conclusion is that there are reasons for thinking that connectionist forms of representation are the enemy of both TT and ST. So the contribution of connectionism may be to suggest the need for an alternative to both views. (shrink)

The mechanism by which humans perceive others differs greatly from how humans perceive inanimate objects. Unlike inanimate objects, humans have the distinct property of being “like me” in the eyes of the observer. This allows us to use the same systems that process knowledge about self-performed actions, self-conceived thoughts, and self-experienced emotions to understand actions, thoughts, and emotions in others. The authors propose that internal simulation mechanisms, such as the mirror neuron system, are necessary for normal development of recognition, (...) imitation, theory of mind, empathy, and language. Additionally, the authors suggest that dysfunctional simulation mechanisms may underlie the social and communicative deficits seen in individuals with autism spectrum disorders. (shrink)

Alvin Goldman's early work in action theory and theory of knowledge was a major influence on my own thinking and writing about emotions. For that reason and others, it was a very happy moment in my professional life when I learned, in 1988, that in his presidential address to the Society for Philosophy and Psychology Goldman endorsed and defended the “simulation” theory I had put forward in a 1986 article. I discovered afterward that we share a strong conviction (...) that empirical evidence is relevant to a full assessment of the theory. We both find the burgeoning evidence from cognitive neuroscience to be of particular interest, I believe, in part because it makes possible a major departure for the philosophy of mind: turning its attention from " the neural basis of mental states, " to. (shrink)

There is considerable evidence that language comprehenders derive lexical-semantic meaning by mentally simulating perceptual and motor attributes of described events. However, the nature of these simulations—including the level of detail that is incorporated and contexts under which simulations occur—is not well understood. Here, we examine the effects of first- versus third-person perspective on mental simulations during sentence comprehension. First-person sentences describing physical transfer towards or away from the body modulated response latencies when responses were made along a front-back axis, consistent (...) with the action-sentence compatibility effect. This effect was not observed for third-person sentences. The ACE was observed when making responses along a left-right axis for third-person, but not first-person sentences.sentences did not show an ACE along either axis. These results show that perspective is a detail that is simulated during action sentence comprehension, and that motoric activations are flexible and affected by the pronominal perspective used in the sentence. (shrink)

Simulation Theory says we need not rely exclusively on prepositional knowledge of other minds in order to explain the actions of others. Seeking to know what you will do, I imagine myself in your situation, and see what decision I come up with. I argue that this conception of simulation naturally generalizes: various bits of our mental machine can be run‘off‐line’, fulfilling functions other than those they were made for. In particular, I suggest that visual imagery results when (...) the visual system is run off‐line. I briefly review the empirical evidence and consider the philosophical implications, particularly concerning the mode of mental representation in imagery. (shrink)

This paper is concerned with the problem of self‐identification in the domain of action. We claim that this problem can arise not just for the self as object, but also for the self as subject in the ascription of agency. We discuss and evaluate some proposals concerning the mechanisms involved in self‐identification and in agency‐ascription, and their possible impairments in pathological cases. We argue in favor of a simulation hypothesis that claims that actions, whether overt or covert, are (...) centrally simulated by the neural network, and that this simulation provides the basis for action recognition and attribution. (shrink)