Visual information can be provided to blind users through sensory substitution devices that convert images into sound. Through extensive use to develop expertise, some blind users have reported visual experiences when using such a device. These blind expert users have also reported visual phenomenology to other sounds even when not using the device. The blind users acquired synthetic synaesthesia, with visual experience evoked by sounds only after gaining such expertise. Sensorimotor learning may facilitate and perhaps even be required to develop (...) expertise in the use of multimodal information. Furthermore, other areas where expertise is acquired in dividing attention amongst cross-modal information or integrating such information might also give rise to synthetic synaesthesia. (shrink)

Sensory substitution devices make use of one substituting modality to get access to environmental information normally accessed through another modality . Based on behavioural and neuroimaging data, some authors have claimed that using a vision-substituting device results in visual perception. Reviewing these data, we contend that this claim is untenable. We argue that the kind of information processed by a SSD is metamodal, so that it can be accessed through any sensory modality and that the phenomenology associated with the use (...) of a SSD is best described in terms of spatial phenomenology, only. (shrink)

Unlike those with type 1 blindsight, people who have type 2 blindsight have some sort of consciousness of the stimuli in their blind field. What is the nature of that consciousness? Is it visual experience? I address these questions by considering whether we can establish the existence of any structural—necessary—features of visual experience. I argue that it is very difficult to establish the existence of any such features. In particular, I investigate whether it is possible to visually, or more generally (...) perceptually, experience form or movement at a distance from our body, without experiencing colour. The traditional answer, advocated by Aristotle, and some other philosophers, up to and including the present day, is that it is not and hence colour is a structural feature of visual experience. I argue that there is no good reason to think that this is impossible, and provide evidence from four cases—sensory substitution, achomatopsia, phantom contours and amodal completion—in favour of the idea that it is possible. If it is possible then one important reason for rejecting the idea that people with type 2 blindsight do not have visual experiences is undermined. I suggest further experiments that could be done to help settle the matter. (shrink)

Sensory substitution devices (SSDs) aim to compensate for the loss of a sensory modality, typically vision, by converting information from the lost modality into stimuli in a remaining modality. “The vOICe” is a visual-to-auditory SSD which encodes images taken by a camera worn by the user into “soundscapes” such that experienced users can extract information about their surroundings. Here we investigated how much detail was resolvable during the early induction stages by testing the acuity of blindfolded sighted, naïve vOICe users. (...) Initial performance was well above chance. Participants who took the test twice as a form of minimal training showed a marked improvement on the second test. Acuity was slightly but not significantly impaired when participants wore a camera and judged letter orientations “live”. A positive correlation was found between participants' musical training and their acuity. The relationship between auditory expertise via musical training and the lack of a relationship with visual imagery, suggests that early use of a SSD draws primarily on the mechanisms of the sensory modality being used rather than the one being substituted. If vision is lost, audition represents the sensory channel of highest bandwidth of those remaining. The level of acuity found here, and the fact it was achieved with very little experience in sensory substitution by naïve users is promising. (shrink)

Block (Trends Cogn Sci 7:285–286, 2003) and Prinz (PSYCHE 12:1–19, 2006) have defended the idea that SSD perception remains in the substituting modality (auditory or tactile). Hurley and Noë (Biol Philos 18:131–168, 2003) instead argued that after substantial training with the device, the perceptual experience that the SSD user enjoys undergoes a change, switching from tactile/auditory to visual. This debate has unfolded in something like a stalemate where, I will argue, it has become difficult to determine whether the perception acquired (...) through the coupling with an SSD remains in the substituting or the substituted modality. Within this puzzling deadlock two new approaches have been recently suggested. Ward and Meijer (Conscious Cogn 19:492–500, 2010) describe SSD perception as visual-like but characterize it as a kind of artificially induced synaesthesia. Auvray et al. (Perception 36:416–430, 2007) and Auvray and Myin (Cogn Sci 33:1036–1058, 2009) suggest that SSDs let their users experience a new kind of perception. Deroy and Auvray (forthcoming) refine this position, and argue that this new kind of perception depends on pre-existing senses without entirely aligning with any of them. So, they have talked about perceptual experience in SSDs as going "beyond vision". In a similar vein, MacPherson (Oxford University Press, New York, 2011a) claims that “if the subjects (SSD users) have experiences with both vision-like and touch-like representational characteristics then perhaps they have a sense that ordinary humans do not” (MacPherson in Oxford University Press, New York, 2011a, p. 139). (shrink)

Our use of artefacts has at different moments been characterised as either replacing or impoverishing our natural human capacities, or a key part of our humanity. This article critically evaluates the conception of the natural invoked by both accounts, and highlights the degree to which engagement with material features of the environment is fundamental to all living things, the closeness of this engagement making any account that seeks to draw a clear boundary between body and artefact problematic. By doing this (...) I seek to clarify the nature of our embodied relationship with various kinds of artefacts; moving from tools to machines to digital interfaces, I consider their differing potentials to be gathered into the body schema, and thus change our embodied horizons of perception and action. While much research currently seeks to facilitate a more ‘natural’ mode of interacting with technology, I argue that such a mode of interaction does not exist outside the particularity of our relationships with specific objects. As a result, rather than trying to cater to supposedly more natural modes of action and perception, future technologies should aim to enrich our experience with new modes, inviting novel relationships that produce new kinds of sensory and other experience. (shrink)