This chapter distinguishes between two kinds of ordinary multisensory experience that go beyond mere co-consciousness of features (e.g., the experience that results from concurrently hearing a sound in the hallway and seeing the cup on the table). In one case, a sensory experience in one modality creates a perceptual demonstrative to whose referent qualities are attributed in another sensory modality. For example, when you hear someone speak, auditory experience attributes audible qualities to a seen event, a person’s speaking motions. The (...) second kind of multisensory experience attributes features experienced in several sensory modalities to one and the same object via a process of amodal perceptual integration, i.e., integration that occurs separately from processing within the individual sensory modalities. Multisensory experiences arising from holding and seeing a tomato or from seeing the Indian curry boil and smelling it are examples of the second kind of multisensory experience. At the end of the chapter we look at synesthesia, a kind of atypical multisensory experience, and argue that one version of this phenomenon may be able to shed light on the neural mechanism underlying amodally integrated multisensory experience. (shrink)

Despite some principal similarities, there is no systematic comparison between the different types of synesthesia . This comprehensive review compares the three principal types of synesthesia and focuses on their phenomenological features and their relation to different etiological models. Implications of this comparison for the validity of the different etiological models are discussed.Comparison of the three forms of synesthesia show many more differences than similarities. This is in contrast to their representation in the literature, where they are discussed in many (...) respects as being virtually similar. Noteworthy is the much broader spectrum and intensity with the typical drug-induced synesthesias compared to genuine and acquired synesthesias. A major implication of the phenomenological comparison in regard to the etiological models is that genuine and acquired synesthesias point to morphological substrates, while drug-induced synesthesia appears to be based on functional changes of brain activity. (shrink)

Studies of linguistic synaesthesias in English have shown a range of fine-grained language mechanisms governing the associations between colours on the one hand, and graphemes, phonemes and words on the other. However, virtually nothing is known about how synaesthetic colouring might operate in non-alphabetic systems. The current study shows how synaesthetic speakers of Mandarin Chinese come to colour the logographic units of their language. Both native and non-native Chinese speakers experienced synaesthetic colours for characters, and for words spelled in the (...) Chinese spelling systems of Pinyin and Bopomo. We assessed the influences of lexical tone and Pinyin/Bopomo spelling and showed that synaesthetic colours are assigned to Chinese words in a non-random fashion. Our data show that Chinese-speaking synaesthetes with very different native languages can exhibit both differences and similarities in the ways in which they come to colour their Chinese words. (shrink)

Determining the nature of binding in grapheme-color synaesthesia has consequences for understanding the neural basis of synaesthesia and visual awareness in general. We evaluated type- and token-based letter-color binding using a synaesthetic version of the object-reviewing paradigm. Although mean response times failed to reveal any significant differences between synaesthetes and control participants, RT analyses with ex-Gaussian distributions revealed that the response facilitation in the synaesthesia group reflected type representations exclusively, while response facilitation in the control group, who learned letter-color associations, (...) was dominated by token representations. Thus, letter-color associations in associator synaesthetes are type-based, and do not involve binding to object tokens, consistent with their subjective reports. Contrary to recent studies that failed to find differences between synaesthetes and non-synaesthetes with behavioral measures, response time distribution analyses indicate that color sensations in synaesthetes are not simply the extreme form of normal letter-color associations, and cannot be attributed to demand characteristics. (shrink)

In grapheme-color synesthesia, a number or letter can evoke two different and possibly conflicting color sensations at the same time. In this study, we investigate the relationship between synesthesia and executive control functions. First, no general skill differences were obtained between synesthetes and non-synesthetes in classic executive control paradigms. Furthermore, classic executive control effects did not interact with synesthetic behavioral effects. Third, we found support for our hypothesis that inhibition of a synesthetic color takes effort and time. Finally, individual differences (...) analyses showed no relationship between the two skills; performance on a ‘normal’ Stroop task does not predict performance on a synesthetic Stroop task. Across four studies, the current results consistently show no clear relationship between executive control functions and synesthetic behavioral effects. This raises the question of which mechanisms are at play in synesthetic ‘management’ during the presence of two conflicting sensations. (shrink)

Recently, swimming-style colour synaesthesia was introduced as a new form of synaesthesia. A synaesthetic Stroop test was used to establish its genuineness. Since Stroop interference can occur for any type of overlearned association, in the present study we used a modified Stroop test and psychophysiological synaesthetic conditioning to further establish the genuineness of this form of synaesthesia. We compared the performance of a swimming-style colour synaesthete and a control who was trained on swimming-style colour associations. Our results showed that behavioural (...) aspects of swimming-style colour synaesthesia can be mimicked in a trained control. Importantly, however, our results showed a psychophysiological conditioning effect for the synaesthete only. We discuss the theoretical relevance of swimming-style colour synaesthesia according to different models of synaesthesia. We conclude that swimming-style colour synaesthesia is a genuine form of synaesthesia, can be mimicked behaviourally in non-synaesthetes, and is best explained by a re-entrant feedback model. (shrink)

In Nyāya philosophy, a special kind of extraordinary sensory connection is admitted named jñānalakṣaṇā pratyāsatti or jñānalakṣaṇa sannikarṣa. It is held that sometimes our sense-organ can be connected to such an object which is not amenable to the operating sense-organ. In such cases, cognition (jñāna) plays the role of sensory connection and connects the content of itself to the operating sense-organ. The paradigmatic example of jñānalakṣaṇa perception is to ‘see’ fragrant sandal through visual sense from non-smellable distance. This hypothesis of (...) jñānalakṣaṇa has been criticized by the opponents being considered as counterintuitive, mysterious and theoretically overloaded. This paper tries to demystify the notion. It shows that although it seems to be metaphysically mysterious phenomenon at first sight, it is not so at all. The paper explores the psychological process involved in this sensory connection. The hypothesis is shown to have sufficient explanatory power, because the Naiyāyikas have used this hypothesis to explain five different epistemic situations. Hence, this paper argues that it is not a theoretical overload. The opponents counter-argue that all those five cognitive situations can be explained without admitting jñānalakṣaṇa. Moreover, if we admit jñānalakṣaṇa, then a particular kind of inference will become redundant. The paper answers all those objections and defends the hypothesis. The second part of the paper presents an empirical evidence in support of the hypothesis. The arguments leveled against the hypothesis of jñānalakṣaṇa can be contested on the ground that they try to disprove something which is supported on experimental ground. Experiments represent universally acceptable objective facts supported by experience—denying which amounts to anubhavavirodha, which philosophers would want to avoid. Hence, supporting jñānalakṣaṇa on the ground of scientific experiments can be considered as a philosophical stand. Now, there is a clinically recognized and neurophysiologically proved condition, called synaesthesia, where stimulation of a particular sensory modality automatically and involuntarily activates a different sensory modality simultaneously without a direct stimulation of the second modality. As for example, when a sound → colour synaesthete listens to a particular tone such as C-sharp, she visualizes particular colour, such as blue, in her mind’s eye; for a grapheme → colour synaesthete a particular number or alphabet is always tinged with a particular colour. This paper shows that the cognitive process involved in synaesthesia lends support to the hypothesis of jñānalakṣaṇa pratyāsatti. It has been proved through several experiments that it is a genuine perceptual phenomenon and is not a confabulation of memory. There are several alternative theories which explain the phenomenon neurophysiologically. The paper discusses the most popular one: the cross-activation hypothesis. There are two major objections against the project of comparing jñānalakṣaṇa with synaesthesia. First, synaesthesia is a neurological condition present in a few numbers of people whereas jñānalakṣaṇa is claimed to be universal phenomenon. Second, syneasthesia is a sensory experience whereas jñānalakṣaṇa involves application of concepts. The paper answers these questions. Firstly, multimodal processing in the brain is a universal phenomenon; secondly, there is a form of synaesthesia where top-down processing is involved. In those cases, concepts play important role for having synaesthetic experience. (shrink)

binding of colour and alphanumeric form in synaesthesia. Nature 410.

Recent research on grapheme-colour synesthesia has focused on whether visual attention is necessary to induce a synesthetic percept. The current study investigated the influence of synesthesia on overt visual attention during an oculomotor target selection task. Chromatic and achromatic stimuli were presented with one target among distractors among multiple ‘5’s ). Participants executed an eye movement to the target. Synesthetes and controls showed a comparable target selection performance across conditions and a ‘pop-out effect’ was only seen in the chromatic condition. (...) As a pop-out effect was absent for the synesthetes in the achromatic condition, a synesthetic element appears not to elicit a synesthetic colour, even when it is the target. The synesthetic percepts are not pre-attentively available to distinguish the synesthetic target from synesthetic distractors when elements are presented in the periphery. Synesthesia appears to require full recognition to bind form and colour. (shrink)

Synesthesia is a phenomenon in which an additional nonstandard perceptual experience occurs consistently in response to ordinary stimulation applied to the same or another modality. Recent studies suggest an important role of semantic representations in the induction of synesthesia. In the present proposal we try to link the empirically grounded theory of sensory-motor contingency and mirror system based embodied simulation to newly discovered cases of swimming-style color synesthesia. In the latter color experiences are evoked only by showing the synesthetes a (...) picture of a swimming person or asking them to think about a given swimming style. Neural mechanisms of mirror systems seem to be involved here. It has been shown that for mirror-sensory synesthesia, such as mirror-touch or mirror-pain synesthesia, concurrent experiences are caused by the overactivity in the mirror neuron system responding to the specific observation. The comparison of different forms of synesthesia has the potential of challenging conventional thinking on this phenomenon and providing a more general, sensory-motor account of synesthesia encompassing cases driven by semantic or emulational rather than pure sensory or motor representations. (shrink)

People with grapheme-color synesthesia perceive specific colors when viewing different letters or numbers. Previous studies have suggested that synesthetic color experience can be bistable when induced by an ambiguous character. However, the exact relationship between processes underlying the identity of an alphanumeric character and the experience of the induced synesthetic color has not been examined. In the present study, we explored this by focusing on the temporal relation of inducer identification and color emergence using inducers whose identity could be rendered (...) ambiguous upon rotation of the characters. Specifically, achromatic alphabetic letters and digits were presented at varying angles to 9 grapheme-color synesthetes. Results showed that grapheme identification and synesthetically perceived grapheme color covary with the orientation of the test stimulus and that synesthetes were slower naming the experienced color than identifying the character, particularly at intermediate angles where ambiguity was greatest. (shrink)

Although the condition known as synaesthesia is currently undergoing a scientific resurgence, to date the literature has largely focused on the heterogeneous nature of synaesthesia across individuals. In order to provide a better understanding of synaesthesia, however, general characteristics need to be investigated. Synaesthetic experiences are often described as occurring ‘internally’ or in the ‘mind’s eye’, which is remarkably similar to how we would describe our experience of visual mental imagery. We assessed the role of visual imagery in synaesthesia by (...) sampling a large group of synaesthetes and found that they report experiencing more vivid mental images than controls. These findings have important implications for our general understanding of synaesthesia and, in particular, emphasize the need to control for visual imagery in behavioural and neuroimaging paradigms. (shrink)

Synesthetic experiences of color have been traditionally conceptualized as a perceptual phenomenon. However, recent evidence suggests a role of higher order cognition in the formation of synesthetic experiences. Here, we discuss how synesthetic experiences of color differ from and influence veridical color processing, and how non-perceptual processes such as imagery and color memory might play a role in eliciting synesthetic color experience.

Synesthetic experiences of color have been traditionally conceptualized as a perceptual phenomenon. However, recent evidence suggests a role of higher order cognition in the formation of synesthetic experiences. Here, we discuss how synesthetic experiences of color differ from and influence veridical color processing, and how non-perceptual processes such as imagery and color memory might play a role in eliciting synesthetic color experience.

and apply it to various examples of neural plasticity in which input is rerouted intermodally or intramodally to nonstandard cortical targets. In some cases but not others, cortical activity ‘defers’ to the nonstandard sources of input. We ask why, consider some possible explanations, and propose a dynamic sensorimotor hypothesis. We believe that this distinction is important and worthy of further study, both philosophical and empirical, whether or not our hypothesis turns out to be correct. In particular, the question of how (...) the distinction should be explained is linked to explanatory gap issues for consciousness. Comparative and absolute explanatory gaps should be distinguished: why does neural activity in a particular area of cortex have this qualitative expression rather than that, and why does it have any qualitative expression at all? We use the dominance/deference distinction to address the comparative gaps, both intermodal and intramodal. We do so not by inward scrutiny but rather by expanding our gaze to include relations between brain, body and environment. (shrink)

Grapheme-colour synaesthetes experience unusual colour percepts when they encounter letters and/or digits. Studies of English-speaking grapheme-colour synaesthetes have shown that synaesthetic colours are sometimes triggered by rule-based linguistic mechanisms . In contrast, little is known about synaesthesia in logographic languages such as Chinese. The current study shows the mechanisms by which synaesthetic speakers of Chinese colour their language. One hypothesis is that Chinese characters might be coloured by their constituent morphological units, known as radicals, and we tested this by eliciting (...) synaesthetic colours for characters while manipulating features of the radicals within them. We found that both the function and position of radicals influence the nature of the synaesthetic colour generated. Our data show that in Chinese, as in English, synaesthetic colours are influenced by systematic rules, rather than by random associations, and that these rules are based on existing psycholinguistic mechanisms of language processing. (shrink)

We examine a condition in which units of time, such as months of the year, are associated with specific locations in space. For individuals with this time-space synaesthesia, contiguous time units such as months are spatially linked forming idiosyncratically shaped patterns such as ovals, oblongs or circles. For some individuals, each time unit appears in a highly specific colour. For instance, one of the synaesthetes we studied experienced December as a red area located at arms length to the left of (...) their body. For the same individual May was a blue area located roughly at arms length to the right of their body. We studied four synaesthetes who report spatial associations for the months of the year. We found that the time-space associations experienced by these individuals were consistent across test–retest. In addition, month names directed visual attention to particular locations in space. For some synaesthetes, this directing of spatial attention was quite rapid-in accord with their reports that month names involuntarily bring to mind spatial locations. (shrink)

Are small and large numbers represented similarly or differently on the mental number line? The size effect was used to argue that numbers are represented differently. However, recently it has been argued that the size effect is due to the comparison task and is not derived from the mental number line per se. Namely, it is due to the way that the mental number line is mapped onto the task-relevant output component. Here synesthesia was used to disentangle these two alternatives. (...) In two naming experiments a digit-color synesthete showed that the congruity effect was modulated by number size. These results support the existence of a mental number line with a vaguer numerical representation as numbers increase in size. In addition, the results show that in digit-color synesthesia, colors can evoke numerical representation automatically. (shrink)

Recent research on synesthesia has focused on how the condition may depend on selective attention, but there is a lack of consensus on whether selective attention is required to bind colors to their grapheme inducers. In the present study, we used a novel change detection paradigm to examine whether synesthetic colors guide the subject’s attention to the location of the inducer or whether selective attention is required to act as a unique feature during visual search. If synesthetic experiences are elicited (...) by inducers without selective attention, then a target that is distinct from the distractors by virtue of its unique synesthetic color should capture attention. This should lead to efficiency in the search that is analogous to the efficiency in searches involving unique display colors. If, however, an inducer does not elicit a synesthetic color until the subject selectively attends to it, then the search should be as inefficient as for control subjects. We found that, not only does synesthesia not provide an advantage in complicated visual search tasks, it offers a slight disadvantage, supporting the re-entrant processing hypothesis about the mechanism underlying synesthesia. (shrink)

In synaesthesia, ordinary stimuli elicit extraordinary conscious experiences. For example, standard black digits may elicit highly specific colour experiences and specific tastes may elicit unusual tactile sensations. The growing interest in synaesthesia has led to numerous experimental studies of this phenomenon. The purpose of this paper is to review these recent studies and to discuss the relationship between the results of these experimental investigations of synaesthesia and the subjective descriptions reported by synaesthetes. It is argued that when the experimental investigations (...) of synaesthesia are interpreted in the context of synaesthetes' subjective reports, the experimental investigations synergistically advance our understanding of synaesthesia. Ultimately we suggest that a more complete understanding of this fascinating phenomenon will require a clearly articulated combination of well-designed experimental studies and the subjective reports of synaesthetes. (shrink)

(1) The induced colours led to perceptual grouping and pop-out, (2) a grapheme rendered invisible through ‘crowding’ or lateral masking induced synaesthetic colours — a form of blindsight — and (3) peripherally presented graphemes did not induce colours even when they were clearly visible. Taken collectively, these and other experiments prove conclusively that synaesthesia is a genuine percep- tual phenomenon, not an effect based on memory associations from childhood or on vague metaphorical speech. We identify different subtypes of number–colour synaesthesia (...) and propose that they are caused by hyperconnectivity between col- our and number areas at different stages in processing; lower synaesthetes may have cross-wiring (or cross-activation) within the fusiform gyrus, whereas higher synaesthetes may have cross-activation in the angular gyrus. This hyperconnec- tivity might be caused by a genetic mutation that causes defective pruning of con- nections between brain maps. The mutation may further be expressed selectively (due to transcription factors) in the fusiform or angular gyri, and this may explain the existence of different forms of synaesthesia. If expressed very diffusely, there may be extensive cross-wiring between brain regions that represent abstract concepts, which would explain the link between creativity, metaphor and synaesthesia (and the higher incidence of synaesthesia among artists and poets). Also, hyperconnectivity between the sensory cortex and amygdala would explain the heightened aversion synaesthetes experience when seeing numbers printed in the ‘wrong’ colour. Lastly, kindling (induced hyperconnectivity in the temporal lobes of temporal lobe epilepsy [TLE] patients) may explain the purported higher incidence of synaesthesia in these patients. We conclude with a synaesthesia-based theory. (shrink)

This article supplements our earlier paper on synaesthesia published in JCS (Ramachandran & Hubbard, 2001a). We discuss the phenomenology of synaesthesia in greater detail, raise several new questions that have emerged from recent studies, and suggest some tentative answers to these questions.