Cognitive Science 36 (2):305-332 (2012)
AbstractHow do people learn multisensory, or amodal, representations, and what consequences do these representations have for perceptual performance? We address this question by performing a rational analysis of the problem of learning multisensory representations. This analysis makes use of a Bayesian nonparametric model that acquires latent multisensory features that optimally explain the unisensory features arising in individual sensory modalities. The model qualitatively accounts for several important aspects of multisensory perception: (a) it integrates information from multiple sensory sources in such a way that it leads to superior performances in, for example, categorization tasks; (b) its performances suggest that multisensory training leads to better learning than unisensory training, even when testing is conducted in unisensory conditions; (c) its multisensory representations are modality invariant; and (d) it predicts ‘‘missing” sensory representations in modalities when the input to those modalities is absent. Our rational analysis indicates that all of these aspects emerge as part of the optimal solution to the problem of learning to represent complex multisensory environments
Added to PP
Historical graph of downloads
References found in this work
Judgment Under Uncertainty: Heuristics and Biases.Daniel Kahneman, Paul Slovic & Amos Tversky (eds.) - 1982 - Cambridge University Press.
Judgement Under Uncertainty: Heuristics and Biases.Daniel Kahneman, Paul Slovic & Amos Tversky - 1985 - British Journal for the Philosophy of Science 36 (3):331-340.
The Probabilistic Mind: Prospects for Bayesian Cognitive Science.Nick Chater & Mike Oaksford (eds.) - 2008 - Oxford University Press.
Citations of this work
The Shifting Border Between Perception and Cognition.Ben Phillips - 2019 - Noûs 53 (2):316-346.
The Computational Origin of Representation.Steven T. Piantadosi - 2021 - Minds and Machines 31 (1):1-58.
Similar books and articles
Close to Me: Multisensory Space Representations for Action and Pre-Reflexive Consciousness of Oneself-in-the-World.Dorothée Legrand, Claudio Brozzoli, Yves Rossetti & Alessandro Farnè - 2007 - Consciousness and Cognition 16 (3):687-699.
Synesthetic Binding and the Reactivation Model of Memory.Berit Brogaard - forthcoming - In Ophelia Deroy (ed.), Sensory Blending: On Synaesthesia and Related Phenomena. Oxford University Press.
Multisensory Integration of Dynamic Faces and Voices in Rhesus Monkey Auditory Cortex.Joost X. Maier - unknown
The Bodily Social Self: A Link Between Phenomenal and Narrative Selfhood.Harry Farmer & Manos Tsakiris - 2012 - Review of Philosophy and Psychology 3 (1):125-144.
Probability Rather Than Logic as the Basis of Perception.Thomas J. Anastasio - 2003 - Behavioral and Brain Sciences 26 (3):283-284.
Input-Driven Behavior: One Extreme of the Multisensory Perceptual Continuum.Kelvin S. Oie & John J. Jeka - 2001 - Behavioral and Brain Sciences 24 (2):232-233.
The Multisensory Perception of Flavor.Malika Auvray & Charles Spence - 2008 - Consciousness and Cognition 17 (3):1016-1031.
Applying Semantic Concepts to the Media Assigment Problem in Multi-Media Communication.Keith Stenning & Robert Inder - 1995 - In [Book Chapter].
A Qualitative Analysis of Sensory Phenomena Induced by Perceptual Deprivation.Donna M. Lloyd, Elizabeth Lewis, Jacob Payne & Lindsay Wilson - 2012 - Phenomenology and the Cognitive Sciences 11 (1):95-112.
The Sensorimotor Contingency of Multisensory Localization Correlates with the Conscious Percept of Spatial Unity.Gwendolyn E. Roberson, Mark T. Wallace & James A. Schirillo - 2001 - Behavioral and Brain Sciences 24 (5):1001-1002.
Active Perception and the Representation of Space.Mohan Matthen - 2014 - In Dustin Stokes, Mohan Matthen & Stephen Biggs (eds.), Perception and Its Modalities. Oxford University Press. pp. 44-72.
Divide Et Impera? Towards Integrated Multisensory Perception and Action.Claudio Brozzoli, Alessandro Farnè & Yves Rossetti - 2007 - Behavioral and Brain Sciences 30 (2):202-203.