The neuroscience of dance is a vibrant, fast growing field which embodies the promise of a genuine and productive interdisciplinary rapprochement between neuroscience and art. The strength of this field lies in the way it ties the experience of dance to sensorimotor processes that underwrite our ordinary perceptual engagement with the environment. Motor simulation and mimicry enhance our capacity to interpret the goals, motives, and emotions of others. Recent studies demonstrate that these same processes enable us to recognize abstract (...) dance movements as intentional actions with emotionally expressive and semantic content constitutive of their meaning. In what follows I examine this research with an eye to the potential contribution neuroscience can make to our understanding of dance as an artform. (shrink)

This commentary addresses an additional feature of biorobotic modeling: usefulness in prosthetic design. By implementing structurally and behaviorally accurate models as prosthetics, biologically accurate restoration can be approximated. This has potential to reestablish important peripheral elements of the sensorimotor control system, including limb biomechanics, proprioception, and vision. Examples given include musculoskeletal prosthetics and retinal implants.

The Bayesian brain hypothesis, predictive processing, and variational free energy minimisation are typically used to describe perceptual processes based on accurate generative models of the world. However, generative models need not be veridical representations of the environment. We suggest that they can be used to describe sensorimotor relationships relevant for behaviour rather than precise accounts of the world.

Sensorimotor psychology studies the mental processes that control goal-directed bodily motion. Recently, sensorimotor psychologists have provided empirically successful Bayesian models of motor control. These models describe how the motor system uses sensory input to select motor commands that promote goals set by high-level cognition. I highlight the impressive explanatory benefits offered by Bayesian models of motor control. I argue that our current best models assign explanatory centrality to a robust notion of mental representation. I (...) deploy my analysis to defend intentional realism, to rebut eliminativism and instrumentalism regarding mental representation, and to explore the relation between intentionality and normativity. (shrink)

The discovery of so-called ‘mirror neurons’ - found to respond both to own actions and the observation of similar actions performed by others - has been enormously influential in the cognitive sciences and beyond. Given the self-other symmetry these neurons have been hypothesized as underlying a ‘mirror mechanism’ that lets us share representations and thereby ground core social cognitive functions from intention understanding to linguistic abilities and empathy. I argue that mirror neurons are important for very different reasons. Rather than (...) a symmetric ubiquitous or context- independent mechanism, I propose that these neurons are part of broader sensorimotor circuits, which help us navigate and predict the social affordance space that we meet others in. To develop both the critical and positive project I analyze the interpretive choices and the debate surrounding the mirror neuron research and show how the field is marred by highly questionable assumptions about respectively motor and social cognition. The discovery of mirror neurons - and the sensorimotor circuits of which these neurons are a part – actually empirically challenge many of these tacit assumptions. Findings of sensorimotor goal representations at levels of abstraction well beyond actual sensory information and kinetic movements challenge the idea of motor cognition as primarily output production. Additionally, the focus on 3rd person mindreading of hidden mental states is misguiding the field of social cognition. Much ‘mind-reading’ seems rooted in sensorimotor representations and a developmentally primary 2nd person understanding of actions and the mental lives of others, which precisely breaks the assumed dichotomy between mind and behavior. I propose a Social Affordance model where parallel fronto-parietal sensorimotor circuits support representations not just of other people’s actions but of the overall social affordance space. It is a process that monitors concrete goals and teleological possibilities that the environment affords respectively oneself and other present agents. With this model I hypothesize that the complex spectrum of sensorimotor integrations are indeed essential not only to normal action choice calibration but also to social cognitive abilities, as the sensorimotor teleological representations let us relate to others and understand their action choices in a shared pragmatic and intentional context. (shrink)

The sensorimotor theory of cognition holds that human cognition, along with that of other animals, is determined by sensorimotor structures rather than by uniquely human linguistic structures. The theory has been offered to explain the use of bodily terminology in nonphysical contexts, and to recognize the role of experienced embodiment in cognition. This paper defends a version of the theory which specifies that reasoning makes use of mental models constructed by means of action-planning mechanisms. Evidence is offered (...) from cognitive psychology, the neurosciences, and work in primatology and evolutionary theory. Further scientific and philosophical advantages of the theory are discussed: the theory is more parsimonious than its rival, and it offers better accounts of intrinsic intentionality and consciousness. The paper concludes with observations concerning the role of language in thought. (shrink)

According to the sensorimotor account, vision does not imply theconstruction of internally generated representations of the environment, butit isthe skillful exercise of the sensorimotor contingencies obeying sense-specific laws. In this short study, I focus on the notion of “sensorimotor law” and characterize the kind of explanation providedby the sensorimotor theory as a form of covering law model. I then question the nature of such sensorimotor laws and describe them as mechanisms. I show that a mechanistic (...) interpretation provides a better account of the sensorimotor invariances, which fosters us to rebalance the explanatory burden of sensorimotor action and information. Finally, I show that the question of the roleof representations within the sensorimotor theory should be reconsidered. (shrink)

Mirror neuron research has come a long way since the early 1990s, and many theorists are now stressing the heterogeneity and complexity of the sensorimotor properties of fronto-parietal circuits. However, core aspects of the initial ‘ mirror mechanism ’ theory, i.e. the idea of a symmetric encapsulated mirroring function translating sensory action perceptions into motor formats, still appears to be shaping much of the debate. This article challenges the empirical plausibility of the sensorimotor segregation implicit in the original (...) mirror metaphor. It is proposed instead that the teleological organization found in the broader fronto-parietal circuits might be inherently sensorimotor. Thus the idea of an independent ‘purely perceptual’ goal understanding process is questioned. Further, it is hypothesized that the often asymmetric, heterogeneous and contextually modulated mirror and canonical neurons support a function of multisensory mapping and tracking of the perceiving agents affordance space. Such a shift in the interpretative framework offers a different theoretical handle on how sensorimotor processes might ground various aspects of intentional action choice and social cognition. Mirror neurons would under the proposed “social affordance model” be seen as dynamic parts of larger circuits, which support tracking of currently shared and competing action possibilities. These circuits support action selection processes—but also our understanding of the options and action potentials that we and perhaps others have in the affordance space. In terms of social cognition ‘ mirror ’ circuits might thus help us understand not only the intentional actions others are actually performing—but also what they could have done, did not do and might do shortly. (shrink)

[Andy Clark] What is the relation between perceptual experience and the suite of sensorimotor skills that enable us to act in the very world we perceive? The relation, according to 'sensorimotor models' (O'Regan and Noë 2001, Noë 2004) is tight indeed. Perceptual experience, on these accounts, is enacted via skilled sensorimotor activity, and gains its content and character courtesy of our knowledge of the relations between (typically) movement and sensory stimulation. I shall argue that this formulation (...) is too extreme, and that it fails to accommodate the substantial firewalls, dis-integrations, and special-purpose streamings that form the massed strata of human cognition. In particular, such strong sensorimotor models threaten to obscure the computationally potent insensitivity of key information-processing events to the full subtleties of embodied cycles of sensing and moving. /// [Naomi Eilan] The strong sensorimotor account of perception gives self-induced movements two constitutive roles in explaining visual consciousness. The first says that self-induced movements are vehicles of visual awareness, and for this reason consciousness 'does not happen in the brain only'. The second says that the phenomenal nature of visual experiences is consists in the action-directing content of vision. In response I suggest, first, that the sense in which visual awareness is active should be explained by appeal to the role of attention in visual consciousness, rather than self-induced movements; and second, that the sense in which perceptual consciousness does not happen in the brain only should be explained by appeal to the relational nature of perceptual consciousness, appeal to which also shows why links with action cannot exhaust phenomenal content. (shrink)

We present a model for several early stages of the sensorimotor transformations involved in targeted arm movement. In psychophysical experiments, human subjects pointed to the remembered locations of randomly placed targets in three-dimensional space. They made consistent errors in distance, and from these errors stages in the sensorimotor transformation were deduced. When subjects attempted to move the right index finger to a virtual target they consistently undershot the distance of the more distal targets. Other experiments indicated that the (...) error was in the sensorimotor transformation rather than in the perception of distance. The error was most consistent when evaluated using a spherical coordinate system based at the right shoulder, indicating that the neural representation of target parameters is transformed from a retinocentric representation to a shoulder-centered representation. According to the model, the error in distance results from the neural implementation of a linear approximation in the algorithm to transform shoulder-centered target parameters into a set of arm orientations appropriate for placing the finger on the target. The transformation to final arm orientations places visually derived information into a frame of reference where it can readily be combined with kinesthetically derived information about initial arm orientations. The combination of these representations of initial and final arm orientations could give rise to the representation of movement direction recorded in the motor cortex by Georgopoulos and his colleagues. Later stages, such as the transformation from kinematic to dynamic parameters, or to levels of muscle activation, are beyond the scope of the present model. (shrink)

Despite intensive debates regarding action imitation and sentence imitation, few studies have examined their relationship. In this paper, we argue that the mechanism of action imitation is necessary and in some cases sufficient to describe sentence imitation. We first develop a framework for action imitation in which key ideas of Hurley’s shared circuits model are integrated with Wolpert et al.’s motor selection mechanism and its extensions. We then explain how this action-based framework clarifies sentence imitation without a language-specific faculty. Finally, (...) we discuss the empirical support for and philosophical significance of this perspective. (shrink)

[Andy Clark] What is the relation between perceptual experience and the suite of sensorimotor skills that enable us to act in the very world we perceive? The relation, according to 'sensorimotor models' is tight indeed. Perceptual experience, on these accounts, is enacted via skilled sensorimotor activity, and gains its content and character courtesy of our knowledge of the relations between movement and sensory stimulation. I shall argue that this formulation is too extreme, and that it fails (...) to accommodate the substantial firewalls, dis-integrations, and special-purpose streamings that form the massed strata of human cognition. In particular, such strong sensorimotor models threaten to obscure the computationally potent insensitivity of key information-processing events to the full subtleties of embodied cycles of sensing and moving. /// [Naomi Eilan] The strong sensorimotor account of perception gives self-induced movements two constitutive roles in explaining visual consciousness. The first says that self-induced movements are vehicles of visual awareness, and for this reason consciousness 'does not happen in the brain only'. The second says that the phenomenal nature of visual experiences is consists in the action-directing content of vision. In response I suggest, first, that the sense in which visual awareness is active should be explained by appeal to the role of attention in visual consciousness, rather than self-induced movements; and second, that the sense in which perceptual consciousness does not happen in the brain only should be explained by appeal to the relational nature of perceptual consciousness, appeal to which also shows why links with action cannot exhaust phenomenal content. (shrink)

This paper explores the concept of _sensorimotor activity_ that is central to the enactive model of visual perception developed in Alva Noë’s book, _Action in Perception_. The appeal to sensorimotor activity is, I shall argue, subject to a dilemma. On one interpretation, such activity presupposes representational states, and therefore is unable to aid us in the project of understanding how an organism is able to represent the world. On the other interpretation, sensorimotor activity fails to accommodate the essential (...) normativity of representational states, and is therefore also unable to aid us in the project of understanding representation. The solution, I argue, lies in a new conception of sensorimotor activity, according to which such activity is normative, but where this normativity is not inherited from prior representational states. (shrink)

The human conceptual system comprises simulated information of sensorimotor experience and linguistic distributional information of how words are used in language. Moreover, the linguistic shortcut hypothesis predicts that people will use computationally cheaper linguistic distributional information where it is sufficient to inform a task response. In a pre‐registered category production study, we asked participants to verbally name members of concrete and abstract categories and tested whether performance could be predicted by a novel measure of sensorimotor similarity (based on (...) an 11‐dimensional representation of sensorimotor strength) and linguistic proximity (based on word co‐occurrence derived from a large corpus). As predicted, both measures predicted the order and frequency of category production but, critically, linguistic proximity had an effect above and beyond sensorimotor similarity. A follow‐up study using typicality ratings as an additional predictor found that typicality was often the strongest predictor of category production variables, but it did not subsume sensorimotor and linguistic effects. Finally, we created a novel, fully grounded computational model of conceptual activation during category production, which best approximated typical human performance when conceptual activation was allowed to spread indirectly between concepts, and when candidate category members came from both sensorimotor and linguistic distributional representations. Critically, model performance was indistinguishable from typical human performance. Results support the linguistic shortcut hypothesis in semantic processing and provide strong evidence that both linguistic and grounded representations are inherent to the functioning of the conceptual system. All materials, data, and code are available at https://osf.io/vaq56/. (shrink)

If we abandon the coding metaphor in favor of models of the full behavioral loop, we need a way to dissect that loop into understandable pieces. I suggest that evolutionary data provide a solution. We can subdivide behavior into parallel sensorimotor subsystems by following the phylogenetic history of how those systems differentiated and specialized during our evolution, leading to promising ways of re-interpreting neural activity within the context of its pragmatic role in mediating interaction.

The mechanistic model depicts scientific explanations as involving the discovery of multi-level, organized components that constitute a target phenomenon. Meanwhile, sensorimotor enactivism purports to offer a scientifically informed account of perceptual experience as a skill-laden interactive relationship, constitutively involving both perceiver and world, rather than as an agent-bound representation of the world. Insofar as sensorimotor enactivism identifies an empirically tractable phenomenon – skillful agent-world interaction – and mechanistic explanation establishes the subpersonal components of this phenomenon, the two approaches (...) allow for a fruitful division of labor in investigating perceptual experience. On closer inspection, however, two challenges arise. First, the “representation challenge” arises because promising attempts to set out implementational details of our sensorimotor interaction with the world implicate cognitive representations, creating tension with sensorimotor enactivism’s nonrepresentational commitments. Second, the “reconstitution challenge” arises when mechanistic explanation not only uncovers the components of some established phenomenon but plays a role in “reconstituting” this phenomenon. This means that, through investigating mechanisms, perceptual experience may be reconceived such that its constituents are wholly organism-bound. We explore both challenges to the compatibility of mechanism and sensorimotor enactivism and examine possible solutions. The result is a clearer understanding of the tensions and opportunities for learning between the frameworks. (shrink)

We review studies that indicate a dissociation between the perceptual estimate and the resulting cognitive representation of given properties of a seen object, on the one hand, and the motor action exerted on the same object. We propose that there exist multiple levels of organization of sensorimotor loops and that internal models may be made accessible to one level of organization while remaining inaccessible to another level.

What is the relation between perceptual experience and the suite of sensorimotor skills that enable us to act in the very world we perceive? The relation, according to ‘sensorimotor models’ is tight indeed. Perceptual experience, on these accounts, is enacted via skilled sensorimotor activity, and gains its content and character courtesy of our knowledge of the relations between movement and sensory stimulation. I shall argue that this formulation is too extreme, and that it fails to accommodate (...) the substantial firewalls, dis-integrations, and specialpurpose streamings that form the massed strata of human cognition. In particular, such strong sensorimotor models threaten to obscure the computationally potent insensitivity of key information-processing events to the full subtleties of embodied cycles of sensing and moving. (shrink)

Adapting gross motor movement to match the tempo of auditory rhythmic stimulation is a complex skill with a long developmental trajectory. Drumming tasks have previously been employed with infants and young children to measure the emergence of rhythmic entrainment, and may provide a tool for identification of those with atypical rhythm perception and production. Here we describe a new protocol for measuring infant rhythmic movement that can be employed at scale. In the current study, 50 two-year-olds drummed along with the (...) audiovisual presentation of four steady rhythms, using videos of isochronous drumming at 400, 500, 600, and 700 ms IOI, and provided their spontaneous motor tempo by drumming in silence. Toddlers’ drumming is observed from video recordings made in participants’ own homes, obtained via the Lookit platform for online infant studies. We use OpenPose deep-learning model to generate wireframe estimates of hand and body location for each video. The vertical displacement of the hand was extracted, and the power and frequency of infants’ rhythmic entrainment quantified using Fast Fourier Transforms. We find evidence for age-appropriate tempo-flexibility in our sample. Our results demonstrate the feasibility of a fully digital approach to measuring rhythmic entrainment from within the participant’s home, from early in development. (shrink)

One can study the the evolution of sensorimotor functionality by synthesizing this process in an abstract arti cial life model, speci cally, a population of agents that interact with each other and with their environment in a way that allows natural selection implicitly to shape their sensorimotor couplings. The present paper de nes very general measures of environmental and sensory uncertainty, and of action's direct and indirect e ects on perception, and reports a series of observations of these (...) quantities in the context of the model. (shrink)

The concept of “autonomy”, once at the core of the original enactivist proposal in The Embodied Mind, is nowadays ignored or neglected by some of the most prominent contemporary enactivists approaches. Theories of autonomy, however, come to fill a theoretical gap that sensorimotor accounts of cognition cannot ignore: they provide a naturalized account of normativity and the resources to ground the identity of a cognitive subject in its specific mode of organization. There are, however, good reasons for the contemporary (...) neglect of autonomy as a relevant concept for enactivism. On the one hand, the concept of autonomy has too often been assimilated into autopoiesis and the implications are not always clear for a dynamical sensorimotor approach to cognitive science. On the other hand, the foundational enactivist proposal displays a metaphysical tension between the concept of operational closure, deployed as constitutive, and that of structural coupling ; making it hard to reconcile with the claim that experience is sensorimotorly constituted. This tension is particularly apparent when Varela et al. propose Bittorio as a model of the operational closure of the nervous system as it fails to satisfy the required conditions for a sensorimotor constitution of experience. It is, however, possible to solve these problems by re-considering autonomy at the level of sensorimotor neurodynamics. Two recent robotic simulation models are used for this task, illustrating the notion of strong sensorimotor dependency of neurodynamic patterns, and their networked intertwinement. The concept of habit is proposed as an enactivist building block for cognitive theorizing, re-conceptualizing mental life as a habit ecology, tied within an agent’s behaviour generating mechanism in coordination with its environment. Norms can be naturalized in terms of dynamic, interactively self-sustaining, coherentism. This conception of autonomous sensorimotor agency is put in contrast with those enactive approaches that reject autonomy or neglect the theoretical resources it has to offer for the project of naturalizing minds. (shrink)

The sensorimotor approach to perception addresses various aspects of perceptual experience, but not the subjectivity of intentional action. Conversely, the problem that current accounts of the sense of agency deal with is primarily one of subjectivity. But the proposed models, based on internal signal comparisons, arguably fail to make the transition from subpersonal computations to personal experience. In this paper we suggest an alternative direction towards explaining the sense of agency by braiding three theoretical strands: a world-involving, dynamical (...) interpretation of the sensorimotor approach, an enactive description of sensorimotor agency as contrasted with organic agency in general, and a dynamical theory of equilibration within and between sensorimotor schemes. On this new account, the sense of oneself as the author of one’s own actions corresponds to what we experience during the ongoing adventure of establishing, losing, and re-establishing meaningful interactions with the world. The meaningful relation between agent and world is given by the precarious constitution of sensorimotor agency as a self-asserting network of schemes and dispositions. Acts are owned as they adaptively assert the constitution of the agent. Thus, awareness for different aspects of agency experience, such as the initiation of action, the effort exerted in controlling it, or the achievement of the desired effect, can be accounted for by processes involved in maintaining the sensorimotor organization that enables these interactions with the world. We discuss these processes in detail from a non-representational, dynamical perspective and show how they cohere with the personal experience of agency. (shrink)

Positing the importance of sensorimotor contingencies for perception is by no means denying the presence and importance of representations. Using the evidence of mirror neurons we will show the intrinsic relationship between action control and representation within the logic of forward models.

In _Action in Perception _Alva No develops and presents a sensorimotor account of vision and of visual consciousness. According to such an account seeing (and indeed perceiving more generally) is analysed as a kind of skilful bodily activity. Such a view is consistent with the emerging emphasis, in both philosophy and cognitive science, on the critical role of embodiment in the construction of intelligent agency. I shall argue, however, that the full sensorimotor model faces three important challenges. The (...) first is to negotiate a path between two prima facie unsatisfactory readings of the central claim that conscious perceptual experience is constituted by knowledge of patterns of sensorimotor dependence. The second is to convince us that the sensorimotor contribution, in such cases, is actually constitutive of perceptual experience rather than merely causally implicated in the origination of such experience.² And the third is to respond to the important challenge raised by what I will dub 'sensorimotor summarizing' models of the relation between conscious experience and richly detailed sensorimotor routines. According to such models³ conscious perceptual experience only rather indirectly reflects the rich detail of our actual sensorimotor engagements, which are instead lightly sampled as a coarse guide, optimized for planning and reasoning, and geared and filtered according to current needs and purposes. (shrink)

Several lines of evidence have underscored the remarkable neuroplasticity of the primate sensorimotor cortex, characterizing these cortical areas as dynamic constructs that are modelled in a use-dependent manner by behaviourally significant experiences. Their plasticity likely provides a neural substrate that may contribute to the dynamic systems paradigm argued by Shanker & King (S&K) as crucial for development of communication skills.

If embodied models no longer address the symbol grounding problem and a conceptual system can step in and resolve categorizations when embodied simulations fail, then perhaps the next step in theory-building is to isolate the unique contributions of embodied simulation. What is a disembodied conceptual system incapable of doing with respect to semantic processing or the categorization of smiles?

We propose a view of embodied representations that is alternative to both symbolic/linguistic approaches and purely sensorimotor views of cognition, and can account for procedural and declarative knowledge manipulation. In accordance with recent evidence in cognitive neuroscience and psychology, we argue that anticipatory and simulative mechanisms, which arose during evolution for action control and not for cognition, determined the first form of representational content and were exapted for increasingly sophisticated cognitive uses. In particular, procedural and declarative forms of knowledge (...) can be explained, respectively, in terms of on-line sensorimotor anticipation and off-line simulations of potential actions, which can give access to tacit knowledge and make it explicit. That is, mechanisms that evolved for the on-line prediction of the consequences of one's own actions (i.e. forward models) determine a (procedural) form of representation, and became exapted for off-line use. They can therefore be used to produce (declarative) knowledge of the world, by running a simulation of the action that would produce the relevant information. We conclude by discussing how embodied representations afford a form of internal manipulation that can be described as internalized situated action. (shrink)

Traditionally, the “Imagery Debate” has opposed two main camps: depictivism and descriptivism. This debate has essentially focused on the nature of the internal representations thought to be involved in imagery, without addressing at all the question of action. More recently, a third, “embodied” view is moving the debate into a new phase. The embodied approach focuses on the interdependence of perception, cognition and action, and in its more radical line this approach promotes the idea that perception is not a process (...) involving internal world-models. The anti-representationalist version of the embodied paradigm covers, among others that we shall not discuss here, two quite different positions, namely the enactive approach and sensorimotor theory. Up to now these two anti-representationalist accounts have generally been confounded. In this paper we will argue that despite some important commonalities, enactive and sensorimotor accounts come with distinctive theoretical traits with regard to their approach to imagery. These become manifest when critically examining the role they assign to sensorimotor engagements with the world. We shall argue that enactive and sensorimotor approaches are different in their understanding of the role of embodied action, and these different notions of embodiment lead to different explanatory accounts of perception and imagery. We propose that, due to existing ambiguities in enactivism, the sensorimotor theory is a better framework for a skill-based approach to imagery. (shrink)

concepts are defined as concepts that cannot be experienced directly through the sensorimotor modalities. Explaining our understanding of such concepts poses a challenge to neurocognitive models of knowledge. One account of how these concepts come to be represented is that sensorimotor representations of grounded experiences are reactivated in a way that is constitutive of the abstract concept. In the present experiment, we investigated how sensorimotor information might constitute GOD-related concepts, and whether a person’s self-reported religiosity modulated (...) this grounding. To do so, we manipulated both the state of the body and the state of stimuli in two tasks that required conceptual categorization of abstract words. Linear Mixed Effects model fitting procedures were used to determine which manipulated factors best predicted response latency and accuracy in both tasks. We successfully replicated previous research demonstrating faster categorization of GOD-related words when they were presented at the top of the screen. Importantly, results demonstrated that the kneeling posture manipulation enhanced this effect, as did religiosity, as participants who scored higher in religiosity showed a greater effect of the posture manipulation on the speed with which word categorization occurred when those words were presented in the higher visuospatial presentation condition. Overall, we interpreted our findings to suggest that directly manipulating sensorimotor information can facilitate the categorization of abstract concepts, supporting the notion that this information in part constitutes the representation of abstract concepts. (shrink)

In field computing a topologic organization of CFs is necessary to support sensorimotor planning. A simple model of cortical dynamics can exploit such topologic organization.

Recognized as a simple communicative behavior, referential pointing is cognitively complex because it invites a communicator to consider an addressee's knowledge. Although we know referential pointing is affected by addressees’ physical location, it remains unclear whether and how communicators’ inferences about addressees’ mental representation of the interaction space influence sensorimotor control of referential pointing. The communicative perspective-taking task requires a communicator to point at one out of multiple referents either to instruct an addressee which one should be selected (communicative, (...) COM) or to predict which one the addressee will select (non-communicative, NCOM), based on either which referents can be seen (Level-1 perspective-taking, PT1) or how the referents were perceived (Level-2 perspective-taking, PT2) by the addressee. Communicators took longer to initiate the movements in PT2 than PT1 trials, and they held their pointing fingers for longer at the referent in COM than NCOM trials. The novel findings of this study pertain to trajectory control of the pointing movements. Increasing both communicative and perspective-taking demands led to longer pointing trajectories, with an under-additive interaction between those two experimental factors. This finding suggests that participants generate communicative behaviors that are as informative as required rather than overly exaggerated displays, by integrating communicative and perspective-taking information hierarchically during sensorimotor control. This observation has consequences for models of human communication. It implies that the format of communicative and perspective-taking knowledge needs to be commensurate with the movement dynamics controlled by the sensorimotor system. (shrink)

Open peer commentary on the article “A Computational Constructivist Model as an Anticipatory Learning Mechanism for Coupled Agent–Environment Systems” by Filipo Studzinski Perotto. Upshot: Constructivist theory gives a nice high-level account of how knowledge can be autonomously developed by an agent interacting with an environment, but it fails to detail the mechanisms needed to bridge the gap between low levels of sensorimotor data and higher levels of cognition. AI workers are trying to bridge this gap, using task-specific engineering approaches, (...) without any principled theory to guide them; they could use help from psychologists. (shrink)

Gray's target article presents a model of consciousness that includes several ideas similar to those developed over the past century to explain how sensorimotor information is interpreted by the nervous system. This commentary discusses these ideas and introduces some additional hypotheses, also derived from sensorimotor investigations, that might help improve Gray's model.

Research on hybrid bionic systems (HBSs) is still in its infancy but promising results have already been achieved in laboratories. Experiments on humans and animals show that artificial devices can be controlled by neural signals. These results suggest that HBS technologies can be employed to restore sensorimotor functionalities in disabled and elderly people. At the same time, HBS research raises ethical concerns related to possible exogenous and endogenous limitations to human autonomy and freedom. The analysis of these concerns requires (...) reflecting on the availability of scientific models accounting for key aspects of sensorimotor coordination and plastic adaptation mechanisms in the brain. (shrink)

Ten years ago, one of us proposed a dynamic hierarchical model of intentions that brought together philosophical work on intentions and empirical work on motor representations and motor control (Pacherie, 2008). The model distinguished among Distal intentions, Proximal intentions, and Motor intentions operating at different levels of action control (hence the name DPM model). This model specified the representational and functional profiles of each type of intention, as well their local and global dynamics, and the ways in which they interact. (...) A core insight of the model was that action control is the result of integrated, coordinated activity across these levels of intention. Since the proposal of the model, empirical and theoretical works in philosophy and cognitive science have emerged that would seem to support and expand on this central insight. In particular, an updated understanding of the nature of sensorimotor processing and motor representations, as well as of how the different levels of intention and control interface and interact, allows for the further specification and precisification of the original DPM model. (shrink)

Understanding of the λ model has greatly increased in recent years as evidenced by most of the commentaries. Some commentators underscored the potential of the model to integrate aspects of different sensorimotor systems in the production of movement. Other commentators focused on not-yet-fully-developed parts of the model. A few persisted in misunderstanding some of its basic concepts, and on these grounds they reject it. In responding to commentaries we continue to elaborate on some fundamental points of the model, especially (...) control variables, the idea of movement production by shifting the positional frame of reference and the hypothesis of biomechanical correspondence in motor control. We also continue to develop our ideas on the intrinsic generation of the frame of reference associated with external space and utilized for the control of arm movement and locomotion. The dynamic principles underlying the model are discussed in light of the dynamical systems approach. (shrink)

It is suggested that some limitations of current designs for medical AI systems stem from the failure of those designs to address issues of artificial consciousness. Consciousness would appear to play a key role in the expertise, particularly the moral expertise, of human medical agents, including, for example, autonomous weighting of options in diagnosis; planning treatment; use of imaginative creativity to generate courses of action; sensorimotor flexibility and sensitivity; empathetic and morally appropriate responsiveness; and so on. Thus, it is (...) argued, a plausible design constraint for a successful ethical machine medical or care agent is for it to at least model, if not reproduce, relevant aspects of consciousness and associated abilities. In order to provide theoretical grounding for such an enterprise we examine some key philosophical issues that concern the machine modelling of consciousness and ethics, and we show how questions relating to the first research goal are relevant to medical machine ethics. We believe that this will overcome a blanket skepticism concerning the relevance of understanding consciousness, to the design and construction of artificial ethical agents for medical or care contexts. It is thus argued that it would be prudent for designers of MME agents to reflect on issues to do with consciousness and medical expertise; to become more aware of relevant research in the field of machine consciousness ; and to incorporate insights gained from these efforts into their designs. (shrink)

How should biological behaviour be modelled? A relatively new approach is to investigate problems in neuroethology by building physical robot models of biological sensorimotor systems. The explication and justification of this approach are here placed within a framework for describing and comparing models in the behavioural and biological sciences. First, simulation models – the representation of a hypothesis about a target system – are distinguished from several other relationships also termed “modelling” in discussions of scientific explanation. (...) Seven dimensions on which simulation models can differ are defined and distinctions between them discussed: 1. Relevance: whether the model tests and generates hypotheses applicable to biology. 2. Level: the elemental units of the model in the hierarchy from atoms to societies. 3. Generality: the range of biological systems the model can represent. 4. Abstraction: the complexity, relative to the target, or amount of detail included in the model. 5. Structural accuracy: how well the model represents the actual mechanisms underlying the behaviour. 6. Performance match: to what extent the model behaviour matches the target behaviour. 7. Medium: the physical basis by which the model is implemented. No specific position in the space of models thus defined is the only correct one, but a good modelling methodology should be explicit about its position and the justification for that position. It is argued that in building robot models biological relevance is more effective than loose biological inspiration; multiple levels can be integrated; that generality cannot be assumed but might emerge from studying specific instances; abstraction is better done by simplification than idealisation; accuracy can be approached through iterations of complete systems; that the model should be able to match and predict target behaviour; and that a physical medium can have significant advantages. These arguments reflect the view that biological behaviour needs to be studied and modelled in context, that is, in terms of the real problems faced by real animals in real environments. Key Words: animal behaviour; levels; models; neuroethology; realism; robotics; simulation. (shrink)

Large Language Models (LLMs) have been transformative. They are pre-trained foundational models that are self-supervised and can be adapted with fine tuning to a wide range of natural language tasks, each of which previously would have required a separate network model. This is one step closer to the extraordinary versatility of human language. GPT-3 and more recently LaMDA can carry on dialogs with humans on many topics after minimal priming with a few examples. However, there has been a (...) wide range of reactions and debate on whether these LLMs understand what they are saying or exhibit signs of intelligence. This high variance is exhibited in three interviews with LLMs reaching wildly different conclusions. A new possibility was uncovered that could explain this divergence. What appears to be intelligence in LLMs may in fact be a mirror that reflects the intelligence of the interviewer, a remarkable twist that could be considered a Reverse Turing Test. If so, then by studying interviews we may be learning more about the intelligence and beliefs of the interviewer than the intelligence of the LLMs. As LLMs become more capable they may transform the way we interact with machines and how they interact with each other. Increasingly, LLMs are being coupled with sensorimotor devices. LLMs can talk the talk, but can they walk the walk? A road map for achieving artificial general autonomy is outlined with seven major improvements inspired by brain systems. LLMs could be used to uncover new insights into brain function by downloading brain data during natural behaviors. (shrink)

Imitation, deliberation, and mindreading are characteristically human sociocognitive skills. Research on imitation and its role in social cognition is flourishing across various disciplines. Imitation is surveyed in this target article under headings of behavior, subpersonal mechanisms, and functions of imitation. A model is then advanced within which many of the developments surveyed can be located and explained. The shared circuits model (SCM) explains how imitation, deliberation, and mindreading can be enabled by subpersonal mechanisms of control, mirroring, and simulation. It is (...) cast at a middle, functional level of description, that is, between the level of neural implementation and the level of conscious perceptions and intentional actions. The SCM connects shared informational dynamics for perception and action with shared informational dynamics for self and other, while also showing how the action/perception, self/other, and actual/possible distinctions can be overlaid on these shared informational dynamics. It avoids the common conception of perception and action as separate and peripheral to central cognition. Rather, it contributes to the situated cognition movement by showing how mechanisms for perceiving action can be built on those for active perception.;>;>The SCM is developed heuristically, in five layers that can be combined in various ways to frame specific ontogenetic or phylogenetic hypotheses. The starting point is dynamic online motor control, whereby an organism is closely attuned to its embedding environment through sensorimotor feedback. Onto this are layered functions of prediction and simulation of feedback, mirroring, simulation of mirroring, monitored inhibition of motor output, and monitored simulation of input. Finally, monitored simulation of input specifying possible actions plus inhibited mirroring of such possible actions can generate information about the possible as opposed to actual instrumental actions of others, and the possible causes and effects of such possible actions, thereby enabling strategic social deliberation. Multiple instances of such shared circuits structures could be linked into a network permitting decomposition and recombination of elements, enabling flexible control, imitative learning, understanding of other agents, and instrumental and strategic deliberation. While more advanced forms of social cognition, which require tracking multiple others and their multiple possible actions, may depend on interpretative theorizing or language, the SCM shows how layered mechanisms of control, mirroring, and simulation can enable distinctively human cognitive capacities for imitation, deliberation, and mindreading. (shrink)

ABSTRACT How can imagination generate knowledge when its contents are voluntarily determined? Several philosophers have recently answered this question by pointing to the constraints that underpin imagination when it plays knowledge-generating roles. Nevertheless, little has been said about the nature of these constraints. In this paper, I argue that the constraints that underpin sensory imagination come from the structure of causal probabilistic generative models, a construct that has been highly influential in recent cognitive science and machine learning. I highlight (...) several attractions of this account, and I favourably contrast it with Peter Langland-Hassan’s account of sensory imagination in terms of the forward models exploited in sensorimotor control. (shrink)

ABSTRACT How can imagination generate knowledge when its contents are voluntarily determined? Several philosophers have recently answered this question by pointing to the constraints that underpin imagination when it plays knowledge-generating roles. Nevertheless, little has been said about the nature of these constraints. In this paper, I argue that the constraints that underpin sensory imagination come from the structure of causal probabilistic generative models, a construct that has been highly influential in recent cognitive science and machine learning. I highlight (...) several attractions of this account, and I favourably contrast it with Peter Langland-Hassan’s account of sensory imagination in terms of the forward models exploited in sensorimotor control. (shrink)

Describing actions entails that relations between objects are discovered. A pervasively neural account of this process requires that fundamental problems are solved: the neural pointer problem, the binding problem, and the problem of generating discrete processing steps from time-continuous neural processes. We present a prototypical solution to these problems in a neural dynamic model that comprises dynamic neural fields holding representations close to sensorimotor surfaces as well as dynamic neural nodes holding discrete, language-like representations. Making the connection between these (...) two types of representations enables the model to describe actions as well as to perceptually ground movement phrases—all based on real visual input. We demonstrate how the dynamic neural processes autonomously generate the processing steps required to describe or ground object-oriented actions. By solving the fundamental problems of neural pointing, binding, and emergent discrete processing, the model may be a first but critical step toward a systematic neural processing account of higher cognition. (shrink)