This paper addresses the question how to analyze multimodal public discourse in such a way that the resulting reconstruction of the rhetor’s accountability either obliges the rhetor to acknowledge the argumentative reconstruction as valid or to refute its validity in a meta-discussion. This is a challenge for discourse theory as well as for argument theory because multimodal discourse seems far removed from the ‘standard’ propositional format of an argument. We argue that multimodal discourse should be analyzed as a coherent and (...) relevant discourse, assuming the possibility of instant interactions between all modes. We introduce a method that allows us to account for an argumentative reconstruction in a systematic way. We illustrate our method by analyzing the ABC news item titled Hu Jintao Visit: Economics and Panda Bears of January 20, 2011, holding ABC news as a rhetor accountable for several far reaching standpoints that are implied in the multimodal format. (shrink)

Restrictivists hold that visual experience only represents low-level properties such as shape, spatial location, motion, color, etc. Expansionists contend that visual experience also represents high-level properties such as being a pine tree. I outline a new approach to support expansionism called the conflict cross-modal argument. What I call the conflict cross-modal effects occur when at least two perceptual systems disagree about some property belonging to a common stimulus, and this disagreement causes a change in the representational and phenomenal content of (...) the perceptual experience associated with one, or both, modalities. The conflict cross-modal argument works by accepting that if a property figures in a conflict cross-modal effect, then prima facie that property is a strong common sensible between the two modalities, and vision and another modality disagree about a property that is high-level for vision. After outlining this argument, and showing how it overcomes two obstacles that face traditional methods employed to defend expansionism, I turn to the well known Mcgurk effect as a case where vision and audition disagree about phoneme properties in order to employ my argument for the conclusion that phoneme properties are represented in visual experience. The upshot is that since phoneme properties are high-level for vision, we have an argument supporting expansionism. (shrink)

It is commonly believed that human perceptual experiences can be, and usually are, multimodal. What is more, a stronger thesis is often proposed that some perceptual multimodal characters cannot be described simply as a conjunction of unimodal phenomenal elements. If it is the case, then a question arises: what is the additional mode of combination that is required to adequately describe the phenomenal structure of multimodal experiences? The paper investigates what types of audio–visual experiences have phenomenal character that cannot be (...) analysed as a mere conjunction of visual and auditory elements; and how can we properly characterise the required, additional mode of perceptual combination. Three main modes of combination are considered: instantiation, parthood, and grouping. It is argued that some phenomena involving intermodal relations, like spatial and temporal ventriloquism, can be analysed in terms of audio–visual, perceptual grouping. On the other hand, cases of intermodal binding need a different treatment. Experiences involving audio–visual binding should be analysed as experiences presenting objects or events which instantiate, or which have a proper part instantiating, both visually and auditorily determined properties. (shrink)

Cross-modal perceptual illusions occur when a stimulus to one modality impacts perceptual experience associated with another modality. Unlike synaesthesia, cross-modal illusions are intelligible as results of perceptual strategies for dealing with sensory stimulation to multiple modalities, rather than as mere quirks. I argue that understanding cross-modal illusions reveals an important flaw in a widespread conception of the senses, and of their role in perceptual experience, according to which understanding perception and perceptual experience is a matter of assembling independently viable stories (...) about vision, audition, olfaction, and the rest. (shrink)

It is tempting to hold that perceptual experience amounts to a co-conscious collection of visual, auditory, tactual, gustatory, and olfactory episodes. If so, each aspect of perceptual experience on each occasion is associated with a specific modality. This paper, however, concerns a core variety of multimodal perceptual experience. It argues that there is perceptually apparent intermodal feature binding. I present the case for this claim, explain its consequences for theorizing about perceptual experience, and defend it against objections. I maintain that (...) just as one thing may perceptually appear at once to jointly bear several features associated with the same sense modality, one thing also may perceptually appear at once to jointly bear features associated with different sense modalities. For instance, just as something may visually appear at once to be both red and round, or to have a red part and a green part, something may multimodally perceptually appear at once to be both bright and loud, or to have a red part and a rough part. The main lesson, I argue, is that perceiving is not just co-consciously seeing, hearing, feeling, tasting, and smelling at the same time. And perceptual phenomenal character is not on each occasion exhausted by that which is distinctive to or associated with a given modality, along with that which accrues thanks to simple co-consciousness. Not all ways of perceiving are modality specific. I defend this account against three main objections: that singular content theorists avoid my conclusions; that apparent infusion of perceptible features is required for perceptually apparent binding but does not occur intermodally; and that the diversity of objects across modalities makes perceptually apparent intermodal binding rare. (shrink)

Psychophysics and neuroscience demonstrate that different sensory systems interact and influence each other. Perceiving involves extensive cooperation and coordination among systems associated with sight, hearing, touch, smell, and taste. Nonetheless, it remains unclear in what respects conscious perceptual awareness is multisensory. This paper distinguishes six differing varieties of multisensory awareness, explicates their consequences, and thereby elucidates the multisensory nature of perception. It argues on these grounds that perceptual awareness need not be exhausted by that which is associated with each of (...) the respective sensory modalities along with whatever accrues thanks to simple co-consciousness. (shrink)

Following on from ecological theories of perception, such as the one proposed by [Gibson, J. J. . The senses considered as perceptual systems. Boston: Houghton Mifflin] this paper reviews the literature on the multisensory interactions underlying the perception of flavor in order to determine the extent to which it is really appropriate to consider flavor perception as a distinct perceptual system. We propose that the multisensory perception of flavor may be indicative of the fact that the taxonomy currently used to (...) define our senses is simply not appropriate. According to the view outlined here, the act of eating allows the different qualities of foodstuffs to be combined into unified percepts; and flavor can be used as a term to describe the combination of tastes, smells, trigeminal, and tactile sensations as well as the visual and auditory cues, that we perceive when tasting food. (shrink)

The first part of this survey article presented a cartography of some of the more extensively studied forms of multisensory processing. In this second part, I turn to examining some of the different possible ways in which the structure of conscious perceptual experience might also be characterized as multisensory. In addition, I discuss the significance of research on multisensory processing and multisensory consciousness for philosophical debates concerning the modularity of perception, cognitive penetration, and the individuation of the senses.

People’s awareness of tactile stimuli has been investigated in far less detail than their awareness of stimuli in other sensory modalities. In an attempt to fill this gap, we provide an overview of studies that are pertinent to the topic of tactile consciousness. We discuss the results of research that has investigated phenomena such as “change blindness”, phantom limb sensations, and numerosity judgments in tactile perception, together with the results obtained from the study of patients affected by deficits that can (...) adversely affect tactile perception such as neglect, extinction, and numbsense. The similarities as well as some of the important differences that have emerged when visual and tactile conscious information processing have been compared using similar experimental procedures are highlighted. We suggest that conscious information processing in the tactile modality cannot be separated completely from the more general processing of spatial information in the brain. Finally, the importance of considering tactile consciousness within the larger framework of multisensory information processing is also discussed. (shrink)

There is growing interest in the effect of sound on visual motion perception. One model involves the illusion created when two identical objects moving towards each other on a two-dimensional visual display can be seen to either bounce off or stream through each other. Previous studies show that the large bias normally seen toward the streaming percept can be modulated by the presentation of an auditory event at the moment of coincidence. However, no reports to date provide sufficient evidence to (...) indicate whether the sound bounce-inducing effect is due to a perceptual binding process or merely to an explicit inference resulting from the transient auditory stimulus resembling a physical collision of two objects. In the present study, we used a novel experimental design in which a subliminal sound was presented either 150 ms before, at, or 150 ms after the moment of coincidence of two disks moving towards each other. The results showed that there was an increased perception of bouncing when the subliminal sound was presented at or 150 ms after the moment of coincidence compared to when no sound was presented. These findings provide the first empirical demonstration that activation of the human auditory system without reaching consciousness affects the perception of an ambiguous visual motion display. (shrink)

This paper presents forms of multimodal perceptual experience that undermine the claim that each aspect of perceptual experience is modality specific. In particular, it argues against the thesis that all phenomenal character is modality specific (even making an allowance for co-conscious unity). It concludes that a multimodal perceptual episode may have phenomenal features beyond those that are associated with the specific modalities.

The aim of this paper is to argue that action-guiding vision is not cognitively impenetrable and arguments that suggest otherwise rely on an unjustified identification between actionguiding vision and dorsal vision – a functional and an anatomical way of describing the mind. The examination of these arguments show the importance of making a distinction between the functional and the anatomical level when addressing the problem of cognitive penetrability.

What is the correct procedure for determining the contents of perception? Philosophers tackling this question increasingly rely on empirically-oriented procedures in order to reach an answer. I argue that this constitutes an improvement over the armchair methodology constitutive of phenomenal contrast cases, but that there is a crucial respect in which current empirical procedures remain limited: they are unimodal in nature, wrongly treating the senses as isolatable faculties. I thus have two aims: first, to motivate a reorientation of the admissible (...) contents debate into a multimodal framework, charting its various significances. The second is to explore whether any experimental studies of multimodal perception support a so-called Liberal (or ‘high-level’ or ‘rich’) account of perception’s admissible contents. I conclude that the McGurk effect and the ventriloquist effect are both explicable without the postulation of high-level content, but that at least one multimodal experimental paradigm may necessitate such content: the rubber hand illusion. One upshot of this argument is that Conservatives who claim that the Liberal view intolerably broadens the scope of perceptual illusions, particularly from the perspective of perceptual psychology, should pursue other arguments against that view. (shrink)

This review addresses the role of early sensory areas in the awareness of tactile information in humans. The results of recent studies dealing with this important topic are critically discussed: In particular, we report on evidence from neuropsychology, neurophysiology, neuroimaging, and behavioral experiments that have highlighted the crucial role played by the primary somatosensory cortex in mediating our awareness of tactile information. Phenomena, such as tactile hallucinations, tactile illusions, the perception of supernumerary limbs, and synaesthesia are also discussed. The research (...) reviewed here clearly shows that the activation of SI is necessary, but not sufficient, for the awareness of touch. On the basis of the evidence outlined here, we propose a neurocognitive model that provides a conceptual framework in which to interpret the results of the literature regarding tactile consciousness. (shrink)