Philosophers and cognitive scientists address the relationships among the senses and the connections between conscious experiences that form unified wholes. In this volume, cognitive scientists and philosophers examine two closely related aspects of mind and mental functioning: the relationships among the various senses and the links that connect different conscious experiences to form unified wholes. The contributors address a range of questions concerning how information from one sense influences the processing of information from the other senses and how unified states (...) of consciousness emerge from the bonds that tie conscious experiences together. Sensory Integration and the Unity of Consciousness is the first book to address both of these topics, integrating scientific and philosophical concerns. A flood of recent work in both philosophy and perception science has challenged traditional conceptions of the sensory systems as operating in isolation. Contributors to the volume consider the ways in which perceptual contact with the world is or may be “multisensory,” discussing such subjects as the modeling of multisensory integration and philosophical aspects of sensory modalities. Recent years have seen a similar surge of interest in unity of consciousness. Contributors explore a range of questions on this topic, including the nature of that unity, the degree to which conscious experiences are unified, and the relationship between unified consciousness and the self. Contributors Tim Bayne, David J. Bennett, Berit Brogaard, Barry Dainton, Ophelia Deroy, Frederique de Vignemont, Marc Ernst, Richard Held, Christopher S. Hill, Geoffrey Lee, Kristan Marlow, Farid Masrour, Jennifer Matey, Casey O'Callaghan, Cesare V. Parise, Kevin Rice, Elizabeth Schechter, Pawan Sinha, Julia Trommershaeuser, Loes C. J. van Dam, Jonathan Vogel, James Van Cleve, Robert Van Gulick, Jonas Wulff. (shrink)

This is an excerpt from a report that highlights and explores five questions which arose from the workshop on perceptual learning and perceptual recognition at the University of Toronto, Mississauga on May 10th and 11th, 2012. This excerpt explores the question: Does our representation of time provide and amodal framework for multi-sensory integration?

This is an excerpt of a report that highlights and explores five questions which arose from The Unity of Consciousness and Sensory Integration conference at Brown University in November of 2011. This portion of the report explores the question: Is the mechanism of sensory integration spatio-temporal?

Based on but not limited to material from a conference at Brown University in 2011, Sensory Integration and the Unity of Consciousness is an ambitious collection that brings together two distinct but inter- twined topics.1 In what follows, I briefly explain what sensory integration and the unity of conscious- ness amount to, highlight the contents of the papers, and finally end with general observations and suggestions. I will spend more time on sensory integration, since (...) it is relatively unfamiliar terrain in philosophy. (shrink)

Sensory processing problems and related dysfunctions are among the most common conditions in children with autism spectrum disorder. This study examined the effect of sensory integration therapy on different aspects of occupational performance in children with ASD. The study was conducted on an intervention group receiving SIT and a control group with 3- to 8-year-old children with ASD. The Short Child Occupational Profile was used to compare the two groups in terms of the changes in their occupational (...) performance and the Sensory Profile was used to assess sensory problems. The intervention group showed significantly greater improvement in all the SCOPE domains, as well as in all the SP domains, except for the “emotional reactions” and “emotional/social responses” domains,. The effectiveness of SIT in improving occupational performance in children with ASD as a health-related factor is supported by our findings. (shrink)

This report highlights and explores five questions which arose from The Unity of Consciousness and Sensory Integration conference at Brown University in November of 2011: 1. What is the relationship between the unity of consciousness and sensory integration? 2. Are some of the basic units of consciousness multimodal? 3. How should we model the unity of consciousness? 4. Is the mechanism of sensory integration spatio-temporal? 5. How Should We Study Experience, Given Unity Relations?

Jean Ayres invented Sensory Integration for children experiencing learning and social difficulties because, according to Ayres, they could not adequately integrate information from multiple sensory modalities. She established a scientific basis for her identification of children with sensory integrative difficulties, using statistical techniques to identify symptoms and neuroscience to determine a cause. She was an unusually reflective practitioner who catalyzed a community of practice around SI without becoming a guru—indeed, she encouraged her students to come up (...) with their own ideas and test them empirically. She felt isolated from the growing field of Occupational Therapy yet is viewed as one of its greatest pioneers. After her death in 1988, the SI community gradually began to argue about fundamental issues like what should constitute an appropriate diagnosis and set of tests for SI. At present, the network is fragmented to the point where some of the opposing positions may be incommensurable with each other, which would require a trading zone. (shrink)

Dancers and musicians are experts in spatial and temporal processing which allows them to coordinate movement with music. This high-level processing has been associated with structural and functional adaptation of the brain for high performance sensorimotor integration. For these integration processes, adaptation does not only take place in primary and secondary sensory and motor areas but tertiary brain areas, such as the lateral prefrontal cortex (lPFC) and the intraparietal sulcus (IPS), also provide vital resources for highly specialized (...) performance. Here, we review evidence for the role of these brain areas in multimodal training protocols and integrate these findings into a new model of sensorimotor processing in complex motor learning. (shrink)

What if a blind person could 'see' with her ears? Thanks to Sensory Substitution Devices (SSDs), blind people now have access to out-of-reach objects, a privilege reserved so far for the sighted. In this paper, we show that the philosophical debates have fundamentally been mislead to think that SSDs should be fitted among the existing senses or that they constitute a new sense. Contrary to the existing assumption that they get integrated at the sensory level, we present a (...) new thesis according to which they are not sensory, and get vertically integrated on the top of existing sensory abilities, from which they should be theoretically distinguished. (shrink)

Sensory Individuals: Unimodal and Multimodal Perspectives provides an interdisciplinary, well-balanced, and comprehensive look at different aspects of unisensory and multisensory objects, using both nuanced philosophical analysis and informed empirical work. The research presented in this book represents the field's progression from treating neural sensory processes as primarily modality-specific towards its current state of the art, according to which perception, and its supporting neural processes, are multi-modal, modality-independent, meta-modal, and task-dependent. Even within such approaches sensory stimuli, properties, brain (...) activations, and corresponding perceptual phenomenology can still be characterized in a modality-specific way. The book examines the basic building blocks of human perception, and whether they are best understood as sense modality dependent units of different forms or multimodal perceptual objects. The book combines a variety of innovative and integrative angles to explore the topic and acts as a catalyst for an increasingly diverse field of research, which is in an exciting phase of growth and advancement. New questions are arising as quickly as they are being answered, and the collection Sensory Individuals provides an original and up-to-date addition to the field. (shrink)

A key question in studying consciousness is how neural operations in the brain can identify streams of sensory input as belonging to distinct modalities, which contributes to the representation of qualitatively different experiences. The basis for identification of modalities is proposed to be constituted by self-organized comparative operations across a network of unimodal and multimodal sensory areas. However, such network interactions alone cannot answer the question how sensory feature detectors collectively account for an integrated, yet phenomenally differentiated (...) experiential content. This problem turns out to be different from, although related to, the binding problem. It is proposed that the neural correlate of an enriched, multimodal experience is constituted by the attractor state of a dynamic associative network. Within this network, unimodal and multimodal sensory maps continuously interact to influence each other’s attractor state, so that a feature change in one modality results in a fast re-coding of feature information in another modality. In this scheme, feature detection is coded by firing-rate, whereas firing phase codes relational aspects. (shrink)

Sensory Individuals: Unimodal and Multimodal Perspectives provides an interdisciplinary, well-balanced, and comprehensive look at different aspects of unisensory and multisensory objects, using both nuanced philosophical analysis and informed empirical work. The research presented in this book represents the field's progression from treating neural sensory processes as primarily modality-specific towards its current state of the art, according to which perception, and its supporting neural processes, are multi-modal, modality-independent, meta-modal, and task-dependent. Even within such approaches sensory stimuli, properties, brain (...) activations, and corresponding perceptual phenomenology can still be characterized in a modality-specific way. The book examines the basic building blocks of human perception, and whether they are best understood as sense modality dependent units of different forms or multimodal perceptual objects. The book combines a variety of innovative and integrative angles to explore the topic and acts as a catalyst for an increasingly diverse field of research, which is in an exciting phase of growth and advancement. New questions are arising as quickly as they are being answered, and the collection Sensory Individuals provides an original and up-to-date addition to the field. (shrink)

Postural instability in Parkinson’s disease (PD) is characterized by impaired postural responses to transient perturbations, increased postural sway in stance and difficulty transitioning between tasks. In addition, some studies suggest that loss of dopamine in the basal ganglia due to PD results in difficulty using proprioceptive information for motor control. Here, we quantify the ability of subjects with PD and age-matched control subjects to use and re-weight sensory information for postural control during steady-state conditions of continuous rotations of the (...) stance surface or visual surround. We measure the postural sway of subjects in response to a pseudorandom, surface-tilt stimulus with eyes closed, and in response to a pseudorandom, visual-tilt stimulus. We use a feedback control model of the postural control system to interpret our results, focusing on sensory weighting as a function of stimulus amplitude. We find that subjects with PD can re-weight their dependence upon sensory information in response to changes in surface- or visual-stimulus amplitude. Specifically, subjects with PD behaved like age-matched control subjects by decreasing proprioceptive contribution to stance control with increasing surface-tilt amplitude, and decreasing visual contribution with increasing visual-tilt amplitude. However, subjects with PD do not decrease their reliance on proprioception as much as age-matched controls for small increases in surface-stimulus amplitudes. Levodopa medication did not affect sensory re-weighting behaviors for postural control. The impairment in PD subject’s ability to respond differently to small changes in surface rotation amplitudes is consistent with an increased threshold for perceiving proprioceptive signals, which may result from decreased signal-to-noise in the dopaminergic pathways associated with sensory processing and/or sensory integration. (shrink)

Multisensory integration can alter information processing, and previous research has shown that such processes are modulated by sensory switch costs and prior experience. Here we report an incidental finding demonstrating, for the first time, the interplay between these processes and experimental factors, specifically the presence of the experimenter in the testing room. Experiment 1 demonstrates that multisensory motor facilitation in response to audiovisual stimuli is higher in those trials in which the sensory modality switches than when it (...) repeats. Those participants who completed the study while alone exhibited increased RT variability. Experiment 2 replicated these findings using the letters “b” and “d” presented as unisensory stimuli or congruent and incongruent multisensory stimuli. Multisensory enhancements were inflated following a sensory switch; that is, congruent and incongruent multisensory stimuli resulted in significant gains following a sensory switch in the monitored condition. However, when the participants were left alone, multisensory enhancements were only observed for repeating incongruent multisensory stimuli. These incidental findings therefore suggest that the effects of letter congruence and sensory switching on multisensory integration are partly modulated by the presence of an experimenter. (shrink)

Experimental studies of speech production involving compensations for auditory and somatosensory perturbations and adaptation after training suggest that both types of sensory information are considered to plan and monitor speech production. Interestingly, individual sensory preferences have been observed in this context: subjects who compensate less for somatosensory perturbations compensate more for auditory perturbations, and \textit{vice versa}. We propose to integrate this sensory preference phenomenon in a model of speech motor planning using a probabilistic model in which speech (...) units are characterized both in auditory and somatosensory terms. Sensory preference is implemented in the model according to two approaches. In the first approach, which is often used in motor control models accounting for sensory integration, sensory preference is attributed to the relative precision (i.e., inverse of the variance) of the sensory characterization of the speech motor goals associated with phonological units (which are phonemes in the context of this paper). In the second, ``more original’’ variant, sensory preference is implemented by modulating the sensitivity of the comparison between the predicted sensory consequences of motor commands and the sensory characterizations of the phonemes. We present simulation results using these two variants, in the context of the adaptation to an auditory perturbation, implemented in a 2-dimensional biomechanical model of the tongue. Simulation results show that both variants lead to qualitatively similar results. Distinguishing them experimentally would require precise analyses of partial compensation patterns. However, the second proposed variant implements sensory preference without changing the sensory characterizations of the phonemes. This dissociates sensory preference and sensory characterizations of the phonemes, and makes the account of sensory preference more flexible. Indeed, in the second variant the sensory characterizations of the phonemes can remain stable, when sensory preference varies as a response to cognitive or attentional control. This opens new perspectives for capturing speech production variability associated with aging, disorders and speaking conditions. (shrink)

In numerous peripheral sense organs, external stimuli are detected by primary sensory neurons compartmentalized within specialized structures composed of cuticular or epithelial tissue. Beyond reflecting developmental constraints, such compartmentalization also provides opportunities for grouped neurons to functionally interact. Here, the authors review and illustrate the prevalence of these structural units, describe characteristics of compartmentalized neurons, and consider possible interactions between these cells. This article discusses instances of neuronal crosstalk, examples of which are observed in the vertebrate tastebuds and multiple (...) types of arthropod chemosensory hairs. Particular attention is paid to insect olfaction, which presents especially well‐characterized mechanisms of functional, cross‐neuronal interactions. These examples highlight the potential impact of peripheral processing, which likely contributes more to signal integration than previously considered. In surveying a wide variety of structural units, it is hoped that this article will stimulate future research that determines whether grouped neurons in other sensory systems can also communicate to impact information processing. (shrink)

When a user integrates a sensory substitution device into her life, the process involves perceptual learning, that is, ‘relatively long-lasting changes to an organism’s perceptual system that improve its ability to respond to its environment’ (Goldstone 1998: 585). In this paper, I explore ways in which the extensive literature on perceptual learning can be applied to help improve sensory substitution devices. I then use these findings to answer a philosophical question. Much of the philosophical debate surrounding sensory (...) substitution devices concerns what happens after perceptual learning occurs. In particular, should the resultant perceptual experience be classified in the substituted modality (as vision), in the substituting modality (as auditory or tactile), or in a new sense modality? I propose a novel empirical test to help resolve this philosophical debate. (shrink)

Sensory processing dysfunction is characterized by a behaviorally observed difference in the response to sensory information from the environment. While the cerebellum is involved in normal sensory processing, it has not yet been examined in SPD. Diffusion tensor imaging scans of children with SPD and typically developing controls were compared for fractional anisotropy, mean diffusivity, radial diffusivity, and axial diffusivity across the following cerebellar tracts: the middle cerebellar peduncles, superior cerebellar peduncles, and cerebral peduncles. Compared to TDC, (...) children with SPD show reduced microstructural integrity of the SCP and MCP, characterized by reduced FA and increased MD and RD, which correlates with abnormal auditory behavior, multisensory integration, and attention, but not tactile behavior or direct measures of auditory discrimination. In contradistinction, decreased CP microstructural integrity in SPD correlates with abnormal tactile and auditory behavior and direct measures of auditory discrimination, but not multisensory integration or attention. Hence, altered cerebellar white matter organization is associated with complex sensory behavior and attention in SPD, which prompts further consideration of diagnostic measures and treatments to better serve affected individuals. (shrink)

Drawing on work in psychophysics, psychometrics, and sensory neurophysiology, Clark analyzes the character and defends the integrity of psychophysical explanations of qualitative facts, arguing that the structure of such explanations is sound and potentially successful.

The visuospatial system integrates inner and outer functional processes, organizing spatial, temporal, and social interactions between the brain, body, and environment. These processes involve sensorimotor networks like the eye–hand circuit, which is especially important to primates, given their reliance on vision and touch as primary sensory modalities and the use of the hands in social and environmental interactions. At the same time, visuospatial cognition is intimately connected with memory, self-awareness, and simulation capacity. In the present article, we review issues (...) associated with investigating visuospatial integration in extinct human groups through the use of anatomical and behavioral data gleaned from the paleontological and archaeological records. In modern humans, paleoneurological analyses have demonstrated noticeable and unique morphological changes in the parietal cortex, a region crucial to visuospatial management. Archaeological data provides information on hand–tool interaction, the spatial behavior of past populations, and their interaction with the environment. Visuospatial integration may represent a critical bridge between extended cognition, self-awareness, and social perception. As such, visuospatial functions are relevant to the hypothesis that human evolution is characterized by changes in brain–body–environment interactions and relations, which enhance integration between internal and external cognitive components through neural plasticity and the development of a specialized embodiment capacity. We therefore advocate the investigation of visuospatial functions in past populations through the paleoneurological study of anatomical elements and archaeological analysis of visuospatial behaviors. (shrink)

This collection of new essays on sensory individuals in unimodal and multimodal perception features contributions by outstanding researchers in the fields of philosophy of perception, experimental psychology, and cognitive neuroscience. The topics investigated include conceptual, developmental, and methodological aspects of object perception, and especially how various sense modalities construct their objects from sensory features and feature bearers. The interdisciplinary approach offered has enabled new directions in research on this subject. As ordered in this volume, the topics of the (...) contributions progress from treating neural sensory processes as primarily unisensory towards approaches that take perceptual processing to be modality-independent, meta-modal, and multimodal. Even within these latter approaches, sensory stimuli, sensory properties, brain activations, and corresponding perceptual phenomenology have often been characterized in a modality-specific way. Thus, it is timely to explore the relation between those processes that are unisensory and those that are multisensory. One of the primary themes of this collection is examining whether the basic building blocks of human perception are best understood as modality-dependent units of different forms or in terms of multimodal perceptual objects. Another theme is the relation between low-level object processing (segmentation and perceptual grouping processes) and high-level object knowledge embracing object concept and object-related expectations. A final theme is the role that perceptual objects play as loci of unification in unimodal and multimodal perception, namely that they enable binding and integration of sensory properties to individual entities or events. (shrink)

Theories of binding have recently come into the focus of the consciousness debate. In this review, we discuss the potential relevance of temporal binding mechanisms for sensory awareness. Specifically, we suggest that neural synchrony with a precision in the millisecond range may be crucial for conscious processing, and may be involved in arousal, perceptual integration, attentional selection and working memory. Recent evidence from both animal and human studies demonstrates that specific changes in neuronal synchrony occur during all of (...) these processes and that they are distinguished by the emergence of fast oscillations with frequencies in the gamma-range. (shrink)

Pain is commonly explained in terms of the perceptual activity of a distinct sensory modality, the function of which is to enable us to perceive actual or potential damage to the body. However, the characterization of pain experience in terms of a distinct sensory modality with such content is problematic. I argue that pain is better explained as occupying a different role in relation to perception: to indicate when the stimuli that are sensed in perceiving anything by means (...) of a sensory modality exceed a significant level of intensity. Viewing the system underlying pain experience as an integral and functionally integrated feature of all the senses provides a new perspective on the diverse forms of pain, what it is like to experience pain and the contrasting natures of pain and pleasure. (shrink)

It is typically assumed that while we know other people’s mental states by observing and interpreting their behavior, we know our own mental states by introspection, i.e., without interpreting ourselves. In his latest book, The opacity of mind: An integrative theory of self-knowledge, Peter Carruthers (2011) argues against this assumption. He holds that findings from across the cognitive sciences strongly suggest that self-knowledge of conscious propositional attitudes such as intentions, judgments, and decisions involves a swift and unconscious process of self-interpretation (...) that utilizes the same sensory channels that we employ when working out other people’s mental states. I provide an overview of Carruthers’ book before discussing a pathological case that challenges his account of self-knowledge and mentioning empirical evidence that undermines his use of a particular kind of data in his case against introspection of conscious attitudes. (shrink)

Immanuel Kant’s theory of imagination is a surprisingly fruitful nexus of explanation for the prima facie disparate characteristics of autism spectrum disorder (ASD), especially the sub-spectrum best characterized by the Sensory Integration (SI) and Intense World (IW) theories of ASD. According to the psychological theories that underpin these approaches to autism, upstream effects of sensory processing atypicalities explain a cascade of downstream effects that have been characterized in the diagnostic triad, e.g., poor sensory integration contributes (...) to weak central coherence, which in turn contributes to difficulty participating in a back and forth conversation. To see why Kant’s theory of imagination might be useful, consider that ASD is neither a sensory disorder nor an intellectual disorder per se. Cognitive dysfunction is a common comorbidity of ASD, not a characteristic of it. If we exclude sense and intellect, what’s left? According to Kant, imagination is a synthesizing faculty that mediates between sense and understanding. It does so by transforming intuition from the canonic and vital senses. The uses of imagination include our spatially formative, temporally associative, and communicatively affinitive production, where affinitive production includes sympathy and fantasy. Imagination is thus the faculty of sensory integration, embodied subjectivity, empathy, mindreading, and social cooperation. The wide range of how autism presents and how it is experienced can thus be understood in terms of the atypical development of specific functions of imagination. Kant’s theory of imagination provides a new perspective on how to organize our understanding of autism at the psychological level, one that makes sense of how some of the disparate characteristic phenomena of autism are systematically related and which might lead to novel predictions, research targets, or intervention recommendations. (shrink)

This is an excerpt of a report that highlights and explores five questions which arose from The Unity of Consciousness and Sensory Integration conference at Brown University in November of 2011. This portion of the report explores the question: Are some of the basic units of consciousness multimodal?

This is an excerpt of a report that highlights and explores five questions which arose from The Unity of Consciousness and Sensory Integration conference at Brown University in November of 2011. This portion of the report explores the question: How should we model the unity of consciousness?

This is an excerpt of a report that highlights and explores five questions which arose from The Unity of Consciousness and Sensory Integration conference at Brown University in November of 2011. This portion of the report explores the question: How should we study experience, given unity relations?

How do artists share, translate, reveal their imagination by using different semiotic systems; how can the audience partake in this imagination receiving only images, words, notation, sounds? Starting from artwork of the novelist Italo Calvino and the composers Helmut Lachenmann and Gyorgy Kurtag, this article addresses the relation among imagination, perception, remembrance and expression. The ‘images’ used, be they visual, verbal, auditory or haptic, are much more than images. They concentrate in themselves layers of subjective and intersubjective perceptual, cognitive and (...) emotive experiences. I will argue that imagination relies upon sensory fluidity. This allows us (1) to integrate sensorial experiences from different perceptual origins — synaesthesia, (2) to link past, present and future by way of sensorial and embodied patterns of remembrance — embodied sedimentation, and (3) to share intersubjective patterns of affect and effect, bridging idiosyncratic and universal human experiences. (shrink)

Visual information can be provided to blind users through sensory substitution devices that convert images into sound. Through extensive use to develop expertise, some blind users have reported visual experiences when using such a device. These blind expert users have also reported visual phenomenology to other sounds even when not using the device. The blind users acquired synthetic synaesthesia, with visual experience evoked by sounds only after gaining such expertise. Sensorimotor learning may facilitate and perhaps even be required to (...) develop expertise in the use of multimodal information. Furthermore, other areas where expertise is acquired in dividing attention amongst cross-modal information or integrating such information might also give rise to synthetic synaesthesia. (shrink)

This paper attempts to answer a central question in unsupervised learning: what does it mean to “make sense” of a sensory sequence? In our formalization, making sense involves constructing a symbolic causal theory that both explains the sensory sequence and also satisfies a set of unity conditions. The unity conditions insist that the constituents of the causal theory – objects, properties, and laws – must be integrated into a coherent whole. On our account, making sense of sensory (...) input is a type of program synthesis, but it is unsupervised program synthesis. Our second contribution is a computer implementation, the Apperception Engine, that was designed to satisfy the above requirements. Our system is able to produce interpretable human-readable causal theories from very small amounts of data, because of the strong inductive bias provided by the unity conditions. A causal theory produced by our system is able to predict future sensor readings, as well as retrodict earlier readings, and impute (fill in the blanks of) missing sensory readings, in any combination. In fact, it is able to do all three tasks simultaneously. We tested the engine in a diverse variety of domains, including cellular automata, rhythms and simple nursery tunes, multi-modal binding problems, occlusion tasks, and sequence induction intelligence tests. In each domain, we test our engine's ability to predict future sensor values, retrodict earlier sensor values, and impute missing sensory data. The Apperception Engine performs well in all these domains, significantly out-performing neural net baselines. We note in particular that in the sequence induction intelligence tests, our system achieved human-level performance. This is notable because our system is not a bespoke system designed specifically to solve intelligence tests, but a general-purpose system that was designed to make sense of any sensory sequence. (shrink)