Synesthesia is a phenomenon in which an additional nonstandard perceptual experience occurs consistently in response to ordinary stimulation applied to the same or another modality. Recent studies suggest an important role of semantic representations in the induction of synesthesia. In the present proposal we try to link the empirically grounded theory of sensory-motor contingency and mirror system based embodied simulation to newly discovered cases of swimming-style color synesthesia. In the latter color experiences are evoked only by showing the (...) synesthetes a picture of a swimming person or asking them to think about a given swimming style. Neural mechanisms of mirror systems seem to be involved here. It has been shown that for mirror-sensory synesthesia, such as mirror-touch or mirror-pain synesthesia, concurrent experiences are caused by the overactivity in the mirror neuron system responding to the specific observation. The comparison of different forms of synesthesia has the potential of challenging conventional thinking on this phenomenon and providing a more general, sensory-motor account of synesthesia encompassing cases driven by semantic or emulational rather than pure sensory or motor representations. (shrink)

The full scope of enactivist approaches to cognition includes not only a focus on sensory-motor contingencies and physical affordances for action, but also an emphasis on affective factors of embodiment and intersubjective affordances for social interaction. This strong conception of embodied cognition calls for a new way to think about the role of the brain in the larger system of brain-body-environment. We ask whether recent work on predictive coding offers a way to think about brain function in (...) an enactive system, and we suggest that a positive answer is possible if we interpret predictive coding in a more enactive way, i.e., as involved in the organism’s dynamic adjustments to its environment. (shrink)

An increasing number of research teams are investigating the efficacy of brain-computer interface (BCI)-mediated interventions for promoting motor recovery following stroke. A growing body of evidence suggests that of the various BCI designs, most effective are those that deliver functional electrical stimulation (FES) of upper extremity (UE) muscles contingent on movement intent. More specifically, BCI-FES interventions utilize algorithms that isolate motor signals—user-generated intent-to-move neural activity recorded from cerebral cortical motor areas—to drive electrical stimulation of individual muscles or (...) muscle synergies. BCI-FES interventions aim to recover sensorimotor function of an impaired extremity by facilitating and/or inducing long-term motor learning-related neuroplastic changes in appropriate control circuitry. We developed a non-invasive, electroencephalogram (EEG)-based BCI-FES system that delivers closed-loop neural activity-triggered electrical stimulation of targeted distal muscles while providing the user with multimodal sensory feedback. This BCI-FES system consists of three components: (1) EEG acquisition and signal processing to extract real-time volitional and task-dependent neural command signals from cerebral cortical motor areas, (2) FES of muscles of the impaired hand contingent on the motor cortical neural command signals, and (3) multimodal sensory feedback associated with performance of the behavioral task, including visual information, linked activation of somatosensory afferents through intact sensorimotor circuits, and electro-tactile stimulation of the tongue. In this report, we describe device parameters and intervention protocols of our BCI-FES system which, combined with standard physical rehabilitation approaches, has proven efficacious in treating UE motor impairment in stroke survivors, regardless of level of impairment and chronicity. (shrink)

The sense of agency is a subjective feeling that one's own actions drive action outcomes. Previous studies have focused primarily on the temporal contingency between actions and sensory inputs as a possible mechanism for the sense of agency. However, the contribution of the integrity of visual inputs has not been systematically addressed. In the current study, we developed a psychophysical task to examine the role of visual inputs as well as temporal contingencies toward the sense of agency. Specifically, (...) participants were required to track a target on a sinusoidal curve on a computer screen. Visual integrity of sensory inputs was manipulated by gradually occluding a computer cursor, and participants were asked to report the sense of agency on a nine-point Likert scale. Temporal contingency was manipulated by varying the delay between finger movements on a touchpad and cursor movements. The results showed that the sense of agency was influenced by both visual integrity and temporal contingency. These results are discussed in the context of current models that have proposed that the sense of agency emerges from the comparison of visual inputs with motor commands. (shrink)

Joint attention has been extensively studied in the developmental literature because of overwhelming evidence that the ability to socially coordinate visual attention to an object is essential to healthy developmental outcomes, including language learning. The goal of this study was to understand the complex system of sensory-motor behaviors that may underlie the establishment of joint attention between parents and toddlers. In an experimental task, parents and toddlers played together with multiple toys. We objectively measured joint attention—and the (...) class='Hi'>sensory-motor behaviors that underlie it—using a dual head-mounted eye-tracking system and frame-by-frame coding of manual actions. By tracking the momentary visual fixations and hand actions of each participant, we precisely determined just how often they fixated on the same object at the same time, the visual behaviors that preceded joint attention and manual behaviors that preceded and co-occurred with joint attention. We found that multiple sequential sensory-motor patterns lead to joint attention. In addition, there are developmental changes in this multi-pathway system evidenced as variations in strength among multiple routes. We propose that coordinated visual attention between parents and toddlers is primarily a sensory-motor behavior. Skill in achieving coordinated visual attention in social settings—like skills in other sensory-motor domains—emerges from multiple pathways to the same functional end. (shrink)

Sensory motor contingencies belong to a functionalistic framework. Functionalism does not explain why and how objective functional relations produce phenomenal experience. O'Regan & Noë (O&N) as well as other functionalists do not propose a new ontology that could support the first person subjective phenomenal side of experience.

Traditional spiritual literature contains rich anecdotal reports of spontaneously arising experiences occurring during meditation practice, but formal investigation of such experiences is limited. Previous work has sometimes related spontaneous experiences to the Indian traditional contemplative concept of kundalini. Historically, descriptions of kundalini come out of Tantric schools of Yoga, where it has been described as a “rising energy” moving within the spinal column up to the brain. Spontaneous meditation experiences have previously been studied within Buddhist and Christian practices and within (...) eclectic groups of contemplative practitioners. Prior explorations of kundalini have emphasized extreme experiences, sometimes having clinical consequences. We conducted a first such investigation of kundalini-related experiences within a sample of meditators from a single Tantric Yoga tradition that emphasizes the role of kundalini. We developed a semi-structured questionnaire to conduct an exploratory pilot investigation of spontaneous sensory, motor and affective experiences during meditation practice. In addition to identifying the characteristics of subjective experiences, we measured quantity of meditation, supplemental practices, trait affect and trait mindfulness. We administered it to 80 volunteers at two Ananda Marga retreats. Among reported experiences, we found the highest prevalence for positive mood shifts, followed by motor and then sensory experiences. The frequency of spontaneous experiences was not related to the quantity of practiced meditation or trait measures of mindfulness and affect. Self-reports included multiple descriptions of rising sensations, sometimes being directly called kundalini. Experiences with rising sensations were complex and many included references to positive affect, including ecstatic qualities. There were also reports of spontaneous anomalous experiences. These experiences of rising sensations resemble prior clinical descriptions that were considered kundalini-related. The individuals who reported rising sensations could not be distinguished from other participants based on the incidence of experiences, quantity of meditation practice, or trait measures of mindfulness and affect. In contrast, greater amount of Tantric Yoga meditation practice was associated with greater positive affect, less negative affect and greater mindfulness. Further study of these exploratory findings and how they may be related to spiritual and well-being goals of meditation is warranted along with scientific investigation of purported kundalini phenomena. (shrink)

Sensory Motor Contingencies belong to a functionalistic framework. Functionalism does not give any explanation about why and how objective functional relations should produce phenomenal experience. O’Regan and Noe as well as other functionalists do not propose a new ontology that could support the first person subjective phenomenal side of experience.

David Papineau develops a new argument against representationalism, centering on the idea that sensory experiences are essentially representational on this view. He defends his own “qualitative view” according to which sensory experiences are only contingently representational. I discuss his main argument against essentialist representationalism and then provide two challenges for his positive account. First, Papineau's theory faces a dilemma when it comes to explaining the contents of our perceptual beliefs in situations where the conscious character of sensory (...) experience comes apart from what it represents. Second, we may need to abandon the idea that sensory experiences are assessable for veridicality. (shrink)

While slowness of movement is an obligatory characteristic of Parkinson’s disease (PD), there are conditions in which patients move uncharacteristically fast, attributed to deficient motor inhibition. Here we investigate deficient inhibition in an optimal sensory-motor integration framework, using a game in which subjects used a paddle to catch a virtual ball. Display of the ball was extinguished as soon as the catching movement started, segregating the task into a sensing and acting phase. We analyzed the behavior of (...) 9 PD patients (ON medication) and 10 age-matched controls (HC). The switching times (between sensing and acting phase) were compared to the predicted optimal switching time, based on the individual estimates of sensory and motor uncertainties. The comparison showed that deviation from predicted optimal switching times were similar between groups. However, PD patients showed a weaker correlation between variability in switching time and sensory-motor uncertainty, indicating a reduced propensity to generate exploratory behavior for optimizing goal-directed movements. Analysis of the movement kinematics revealed that PD patients, compared to controls, used a lower peak velocity of the paddle and intercepted the ball with greater velocity. Adjusting the trial duration to the time for the paddle to stop moving, we found that PD patients spent a smaller proportion of the trial duration for observing the ball. Altogether, the results do not show the premature movement initiation and truncated sensory processing that we predicted to ensue from deficient inhibition in PD. (shrink)

We propose that moral behaviour of artificial agents could be intrinsically grounded in their own sensory-motor experiences. Such an ability depends critically on seven types of competencies. First, intrinsic morality should be grounded in the internal values of the robot arising from its physiology and embodiment. Second, the moral principles of robots should develop through their interactions with the environment and with other agents. Third, we claim that the dynamics of moral emotions closely follows that of other non-social (...) emotions used in valuation and decision making. Fourth, we explain how moral emotions can be learned from the observation of others. Fifth, we argue that to assess social interaction, a robot should be able to learn about and understand responsibility and causation. Sixth, we explain how mechanisms that can learn the consequences of actions are necessary for a robot to make moral decisions. Seventh, we describe how the moral evaluation mechanisms outlined can be extended to situations where a robot should understand the goals of others. Finally, we argue that these competencies lay the foundation for robots that can feel guilt, shame and pride, that have compassion and that know how to assign responsibility and blame. (shrink)

Concepts are the elementary units of reason and linguistic meaning. They are conventional and relatively stable. As such, they must somehow be the result of neural activity in the brain. The questions are: Where? and How? A common philosophical position is that all concepts—even concepts about action and perception—are symbolic and abstract, and therefore must be implemented outside the brain’s sensory-motor system. We will argue against this position using (1) neuroscientific evidence; (2) results from neural computation; and (3) (...) results about the nature of concepts from cognitive linguistics. We will propose that the sensory-motor system has the right kind of structure to characterise both sensory-motor and more abstract concepts. Central to this picture are the neural theory of language and the theory of cogs, according to which, brain structures in the sensory-motor regions are exploited to characterise the so-called “abstract” concepts that constitute the meanings of grammatical constructions and general inference patterns. (shrink)

A bodily self is characterized by pre-reflective bodily self-consciousness that is.

In this paper we attempt to advance the enactive discourse on perception by highlighting the role of bodily affects as prenoetic constraints on perceptual experience. Enactivists argue for an essential connection between perception and action, where action primarily means skillful bodily intervention in one’s surroundings. Analyses of sensory-motor contingencies (as in Noë 2004) are important contributions to the enactive account. Yet this is an incomplete story since sensory-motor contingencies are of no avail to the (...) perceiving agent without motivational pull in one direction or another or a sense of the pertinent affective contingencies. Before directly addressing the issue of affect in perception, we explain our peculiar, low-level conception of affect as a form of world-involving intentionality that modulates (minimally) bodily behavior without necessarily possessing informational value of any kind. We then address the deficiency concerning affect in enactive accounts of perception by examining some exemplary forms of bodily affect that constrain perception. We show that bodily affect significantly contributes to (either limiting or enabling) our contact with the world in our perceptually operative attentive outlook, in a kind of perceptual interest or investment, and in social perception. (shrink)

This paper targets the constitutive basis of social cognition. It begins by describing the traditional and still dominant cognitivist view. Cognitivism assumes internalism about the realisers of social cognition; thus, the embodied and embedded elements of intersubjective engagement are ruled out from playing anything but a basic causal role in an account of social cognition. It then goes on to advance and clarify an alternative to the cognitivist view; namely, an enactive account of social cognition. It does so first by (...) articulating a diachronic constitutive account for how embodied engagement can play a constitutive role in social cognition. It then proceeds to consider an objection; the causal-constitutive fallacy (Adams & Aizawa 2001, 2008; Block 2005) against enactive social cognition. The paper proceeds to deflate this objection by establishing that the distinction between constitution and causation is not co-extensive with the distinction between internal constitutive elements and external causal elements. It is then shown that there is a different reason for thinking that an enactive account of social cognition is problematic. We call this objection the ‘poverty of the interactional stimulus argument’. This objection turns on the role and characteristics of anticipation in enactive social cognition. It argues that anticipatory processes are mediated by an internally realised model or tacit theory (Carruthers 2015; Seth 2015). The final part of this paper dissolves this objection by arguing that it is possible to cast anticipatory processes as orchestrated as well as maintained by sensorimotor couplings between individuals in face-to-face interaction. (shrink)

The processing of time intervals in the sub- to supra-second range by the brain is critical for the interaction of primates with their surroundings in activities, such as foraging and hunting. For an accurate processing of time intervals by the brain, representation of physical time within neuronal circuits is necessary. I propose that time dimension of the physical surrounding is represented in the brain by different types of neuronal oscillators, generating spikes or spike bursts at regular intervals. The proposed oscillators (...) include the pacemaker neurons, tonic inputs, and synchronized excitation and inhibition of inter-connected neurons. Oscillators, which are built inside various circuits of brain, help to form modular clocks, processing time intervals or other temporal characteristics specific to functions of a circuit. Relative or absolute duration is represented within neuronal oscillators by “neural temporal unit,” defined as the interval between regularly occurring spikes or spike bursts. Oscillator output is processed to produce changes in activities of neurons, named frequency modulator neuron, wired within a separate module, represented by the rate of change in frequency, and frequency of activities, proposed to encode time intervals. Inbuilt oscillators are calibrated by (a) feedback processes, (b) input of time intervals resulting from rhythmic external sensory stimulation, and (c) synchronous effects of feedback processes and evoked sensory activity. A single active clock is proposed per circuit, which is calibrated by one or more mechanisms. Multiple calibration mechanisms, inbuilt oscillators, and the presence of modular connections prevent a complete loss of interval timing functions of the brain. (shrink)

Motor learning is the process of updating motor commands in response to a trajectory error induced by a perturbation to the body or vision. The brain has a great capability to accelerate learning by increasing the sensitivity of the memory update to the perceived trajectory errors. Conventional theory suggests that the statistics of perturbations or the statistics of the experienced errors induced by the external perturbations determine the learning speeds. However, the potential effect of another type of error (...) perception, a self-generated error as a result of motor command updates, on the learning speeds has not been examined yet. In this study, we dissociated the two kinds of errors by controlling the perception of the aftereffect using a channel-force environment. One group experienced errors due to the aftereffect of the learning process, while the other did not. We found that the participants who perceived the aftereffect of the memory updates exhibited a significant decrease in error-sensitivity, whereas the participants who did not perceive the aftereffect did not show an increase or decrease in error-sensitivity. This suggests that the perception of the aftereffect of learning attenuated updating the motor commands from the perceived errors. Thus, both self-generated and externally induced errors may modulate learning speeds. (shrink)

Several recent accounts claim that imagination is a matter of simulating perceptual acts. Although this point of view receives support from both phenomenological and empirical research, I claim that Jean-Paul Sartre's worry formulated in L'imagination (1936) still holds. For a number of reasons, Sartre heavily criticizes theories in which the sensory material of imaginative acts consists in reviving sensory impressions. Based on empirical and philosophical insights, this article explains how simulation theories of imagination can overcome Sartre's critique by (...) paying attention to the motor dimension of imagination. Intending to clarify the status of the sensory in imagination, a motor theory of imagination is presented in which the sensory component of imagination is interpreted in terms of anticipated sensory consequences of preparation for motor action. (shrink)