When looking at a scene, observers feel that they see its entire structure in great detail and can immediately notice any changes in it. However, when brief blank fields are placed between alternating displays of an original and a modified scene, a striking failure of perception is induced: identification of changes becomes extremely difficult, even when changes are large and made repeatedly. Identification is much faster when a verbal cue is provided, showing that poor visibility is not the cause of (...) this difficulty. Identification is also faster for objects mentioned in brief verbal descriptions of the scene. These results support the idea that observers never form a complete, detailed representation of their surroundings. In addition, results also indicate that attention is required to perceive change, and that in the absence of localized motion signals it is guided on the basis of high-level interest. (shrink)

Change blindness is the striking failure to see large changes that normally would be noticed easily. Over the past decade this phenomenon has greatly contributed to our understanding of attention, perception, and even consciousness. The surprising extent of change blindness explains its broad appeal, but its counterintuitive nature has also engendered confusions about the kinds of inferences that legitimately follow from it. Here we discuss the legitimate and the erroneous inferences that have been drawn, and offer a set of requirements (...) to help separate them. In doing so, we clarify the genuine contributions of change blindness research to our understanding of visual perception and awareness, and provide a glimpse of some ways in which change blindness might shape future research. (shrink)

Five aspects of visual change detection are reviewed. The first concerns the concept of change itself, in particular the ways it differs from the related notions of motion and difference. The second involves the various methodological approaches that have been developed to study change detection; it is shown that under a variety of conditions observers are often unable to see large changes directly in their field of view. Next, it is argued that this “change blindness” indicates that focused attention is (...) needed to detect change, and that this can help map out the nature of visual attention. The fourth aspect concerns how these results affect our understanding of visual perception—for example, the implication that a sparse, dynamic representation underlies much of our visual experience. Finally, a brief discussion is presented concerning the limits to our current understanding of change detection. (shrink)

One of the more powerful impressions created by vision is that of a coherent, richly-detailed world where everything is present simultaneously. Indeed, this impression is so compelling that we tend to ascribe these properties not only to the external world, but to our internal representations as well. But results from several recent experiments argue against this latter ascription. For example, changes in images of real-world scenes often go unnoticed when made during a saccade, flicker, blink, or movie cut. This "change (...) blindness" provides strong evidence against the idea that our brains contain a picture-like representation of the scene that is everywhere detailed and coherent. (shrink)

Advances in neuroscience implicate reentrant signaling as the predominant form of communication between brain areas. This principle was used in a series of masking experiments that defy explanation by feed-forward theories. The masking occurs when a brief display of target plus mask is continued with the mask alone. Two masking processes were found: an early process affected by physical factors such as adapting luminance and a later process affected by attentional factors such as set size. This later process is called (...) masking by object substitution, because it occurs whenever there is a mismatch between the reentrant visual representation and the ongoing lower level activity. Iterative reentrant processing was formalized in a computational model that provides an excellent fit to the data. The model provides a more comprehensive account of all forms of visual masking than do the long-held feed-forward views based on inhibitory contour interactions. (shrink)

Large changes that occur in clear view of an observer can become difficult to notice if made during an eye movement, blink, or other such disturbance. This change blindness is consistent with the proposal that focused visual attention is necessary to see change, with a change becoming difficult to notice whenever conditions prevent attention from being automatically drawn to it. -/- It is shown here how the phenomenon of change blindness can provide new results on the nature of visual attention, (...) including estimates of its capacity and the extent to which it can bind visual properties into coherent descriptions. It is also shown how the resultant characterization of attention can in turn provide new insights into the role that it plays in the perception of scenes and events. (shrink)

Large changes in a scene often become difficult to notice if made during an eye movement, image flicker, movie cut, or other such disturbance. It is argued here that this _change blindness_ can serve as a useful tool to explore various aspects of vision. This argument centers around the proposal that focused attention is needed for the explicit perception of change. Given this, the study of change perception can provide a useful way to determine the nature of visual attention, and (...) to cast new light on the way that it is?and is not?involved in visual perception. To illustrate the power of this approach, this paper surveys its use in exploring three different aspects of vision. The first concerns the general nature of _seeing_. To explain why change blindness can be easily induced in experiments but apparently not in everyday life, it is proposed that perception involves a _virtual representation_, where object representations do not accumulate, but are formed as needed. An architecture containing both attentional and nonattentional streams is proposed as a way to implement this scheme. The second aspect concerns the ability of observers to detect change even when they have no visual experience of it. This _sensing_ is found to take on at least two forms: detection without visual experience (but still with conscious awareness), and detection without any awareness at all. It is proposed that these are both due to the operation of a nonattentional visual stream. The final aspect considered is the nature of visual attention itself?the mechanisms involved when _scrutinizing_ items. Experiments using controlled stimuli show the existence of various limits on visual search for change. It is shown that these limits provide a powerful means to map out the attentional mechanisms involved. (shrink)

Traditionally, vision science and information/data visualization have interacted by using knowledge of human vision to help design effective displays. It is argued here, however, that this interaction can also go in the opposite direction: the investigation of successful visualizations can lead to the discovery of interesting new issues and phenomena in visual perception. Various studies are reviewed showing how this has been done for two areas of visualization, namely, graphical representations and interaction, which lend themselves to work on visual processing (...) and the control of visual operations, respectively. The results of these studies have provided new insights into aspects of vision such as grouping, attentional selection and the sequencing of visual operations. More generally yet, such results support the view that the perception of visualizations can be a useful domain for exploring the nature of visual cognition, inspiring new kinds of questions as well as casting new light on the limits to which information can be conveyed visually. (shrink)

A set of visual search experiments tested the proposal that focused attention is needed to detect change. Displays were arrays of rectangles, with the target being the item that continually changed its orientation or contrast polarity. Five aspects of performance were examined: linearity of response, processing time, capacity, selectivity, and memory trace. Detection of change was found to be a self-terminating process requiring a time that increased linearly with the number of items in the display. Capacity for orientation was found (...) to be about 5 items, a value comparable to estimates of attentional capacity. Observers were able to filter out both static and dynamic variations in irrelevant properties. Analysis also indicated a memory for previously-attended locations. These results support the hypothesis that the process needed to detect change is much the same as the attentional process needed to detect complex static patterns. Interestingly, the features of orientation and polarity were found to be handled in somewhat different ways. Taken together, these results not only provide evidence that focused attention is needed to see change, but also show that change detection itself can provide new insights into the nature of attentional processing. (shrink)

Observers inspected normal, high quality color displays of everyday visual scenes while their eye movements were recorded. A large display change occurred each time an eye blink occurred. Display changes could either involve "Central Interest" or "Marginal Interest" locations, as determined from descriptions obtained from independent judges in a prior pilot experiment. Visual salience, as determined by luminance, color, and position of the Central and Marginal interest changes were equalized. -/- The results obtained were very similar to those obtained in (...) prior experiments showing failure to detect changes occurring simultaneously with saccades, flicker, or “mudsplashes” in the visual scene: Many changes were very hard to detect, and Marginal Interest changes were harder to detect than Central Interest changes. -/- Analysis of eye movements showed, as expected, that the probability of detecting a change depended on the eye’s distance from the change location. However a surprising finding was that both for Central and Marginal Interest changes, evenwhen observers were directly fixating the change locations (within 1 degree),more than 40% of the time they still failed to see the changes. It seems that looking at something does not guarantee you “ see” it. (shrink)

It is argued here that cognitive science currently neglects an important source of insight into the human mind: the effects created by magicians. Over the centuries, magicians have learned how to perform acts that are perceived as defying the laws of nature, and that induce a strong sense of wonder. This article argues that the time has come to examine the scientific bases behind such phenomena, and to create a science of magic linked to relevant areas of cognitive science. Concrete (...) examples are taken from three areas of magic: the ability to control attention, to distort perception, and to influence choice. It is shown how such knowledge can help develop new tools and indicate new avenues of research into human perception and cognition. (shrink)

Magicians use misdirection to prevent you from realizing the methods used to create a magical effect, thereby allowing you to experience an apparently impossible event. Magicians have acquired much knowledge about misdirection, and have suggested several taxonomies of misdirection. These describe many of the fundamental principles in misdirection, focusing on how misdirection is achieved by magicians. In this article we review the strengths and weaknesses of past taxonomies, and argue that a more natural way of making sense of misdirection is (...) to focus on the perceptual and cognitive mechanisms involved. Our psychologically-based taxonomy has three basic categories, corresponding to the types of psychological mechanisms affected: perception, memory, and reasoning. Each of these categories is then divided into subcategories based on the mechanisms that control these effects. This new taxonomy can help organize magicians' knowledge of misdirection in a meaningful way, and facilitate the dialog between magicians and scientists. (shrink)

Change-blindness occurs when large changes are missed under natural viewing conditions because they occur simultaneously with a brief visual disruption, perhaps caused by an eye movement, a flicker, a blink, or a camera cut in a film sequence. We have found that this can occur even when the disruption does not cover or obscure the changes. When a few small, high-contrast shapes are briefly spattered over a picture, like mudsplashes on a car windscreen, large changes can be made simultaneously in (...) the scene without being noticed. (shrink)

We show that early vision can use monocular cues to rapidly complete partially-occluded objects. Visual search for easily detected fragments becomes difficult when the completed shape is similar to others in the display; conversely, search for fragments that are difficult to detect becomes easy when the completed shape is distinctive. Results indicate that completion occurs via the occlusion-triggered removal of occlusion edges and linking of associated regions. We fail to find evidence for a visible filling-in of contours or surfaces, but (...) do find evidence for a "functional" filling-in that prevents the constituent fragments from being rapidly accessed. As such, it is only the completed structures—and not the fragments themselves—that serve as the basis for rapid recognition. (shrink)

It has often been assumed that when we use vision to become aware of an object or event in our surroundings, this must be accompanied by a corresponding visual experience (i.e., seeing). The studies reported here show that this assumption is incorrect. When observers view a sequence of displays alternating between an image of a scene and the same image changed in some way, they often feel (or sense) the change even though they have no visual experience of it. The (...) subjective difference between sensing and seeing is mirrored in several behavioral differences, suggesting that these are two distinct modes of conscious visual perception. (shrink)

Experiments are presented showing that visual search for Mueller-Lyer (ML) stimuli is based on complete configurations, rather than component segments. Segments easily detected in isolation were difficult to detect when embedded in a configuration, indicating preemption by low-level groups. This preemption—which caused stimulus components to become inaccessible to rapid search—was an all-or-nothing effect, and so could serve as a powerful test of grouping. It is shown that these effects are unlikely to be due to blurring by simple spatial filters at (...) early visual levels. It is proposed instead that they are due to more sophisticated processes that rapidly bind contour fragments into spatially-extended assemblies. These results support the view that rapid visual search cannot access the primitives formed at the earliest stages of visual processing; rather, it can access only higher-level, more ecologically-relevant structures. (shrink)

It is suggested that the relationship between visual attention and conscious visual experience can be simplified by distinguishing different aspects of both visual attention and visual experience. A set of principles is first proposed for any possible taxonomy of the processes involved in visual attention. A particular taxonomy is then put forward that describes five such processes, each with a distinct function and characteristic mode of operation. Based on these, three separate kinds—or possibly grades—of conscious visual experience can be distinguished, (...) each associated with a particular combination of attentional processes. (shrink)

Four experiments investigated the extent to which abstract quantitative information can be conveyed by basic visual features. This was done by asking observers to estimate and discriminate Pearson correlation in graphical representations where the first data dimension of each element was encoded by its horizontal position, and the second by the value of one of its visual features; perceiving correlation then requires combining the information in the two encodings via a common abstract representation. Four visual features were examined: luminance, color, (...) orientation, and size. All were able to support the perception of correlation. Indeed, despite the strikingly different appearances of the associated stimuli, all gave rise to performance that was much the same: just noticeable difference was a linear function of distance from complete correlation, and estimated correlation a logarithmic function of this distance. Performance differed only in regards to the level of noise in the feature, with these values compatible with estimates of channel capacity encountered in classic experiments on absolute perceptual magnitudes. These results suggest that quantitative information can be conveyed by visual features that are abstracted at relatively low levels of visual processing, with little representation of the original sensory property. It is proposed that this is achieved via an abstract parameter space in which the values in each perceptual dimension are normalized to have the same means and variances, with perceived correlation based on the shape of the joint probability density function of the resultant elements. (shrink)

When brief blank fields are placed between alternating displays of an original and a modified scene, a striking failure of perception is induced: the changes become extremely difficult to notice, even when they are large, presented repeatedly, and the observer expects them to occur (Rensink, O'Regan, & Clark, 1997). To determine the mechanisms behind this induced "change blindness", four experiments examine its dependence on initial preview and on the nature of the interruptions used. Results support the proposal that representations at (...) the early stages of visual processing are highly volatile, and that focused attention is needed to stabilize them sufficiently to support the perception of change. (shrink)

It has generally been assumed that rapid visual search is based on simple features and that spatial relations between features are irrelevant for this task. Seven experiments involving search for line drawings contradict this assumption; a major determinant of search is the presence of line junctions. Arrow- and Y-junctions were detected rapidly in isolation and when they were embedded in drawings of rectangular polyhedra. Search for T-junctions was considerably slower. Drawings containing T-junctions often gave rise to very slow search even (...) when distinguishing arrow- or Y-junctions were present. This sensitivity to line relations suggests that preattentive processes can extract 3-dimensional orientation from line drawings. A computational model is outlined for how this may be accomplished in early human vision. (shrink)

Our visual experience of the world is one of diverse objects and events, each with particular colors, shapes, and motions. This experience is so coherent, so immediate, and so effortless that it seems to result from a single system that lets us experience everything in our field of view. But however appealing, this belief is mistaken: there are severe limits on what can be visually experienced. -/- For example, in a display for air-traffic control it is important to track all (...) moving items. For a single item, this can be done without problem. Three or four can also be tracked, although some degree of effort may be needed. As the number is increased further, accurate tracking becomes more and more difficult—and eventually, impossible. Performance is evidently affected by a factor within the observer which enables certain kinds of perception to occur, but is limited in some way. This factor is generally referred to as attention. -/- At various times, attention has been associated with clarity of perception, intensity of perception, consciousness, selection, or the allocation of a limited “resource” enabling various operations (see Hatfield, 1998). During the past several decades, considerable progress has been achieved by focusing on the idea of selection (Broadbent, 1982). In particular, attention can be productively viewed as contingently selective processing. This can be embodied in various ways by various processes—there need not be a single quantity identified with all forms of attention, or a single site where it operates (Allport, 1993; Tsotsos, 2011). Although “paying attention” is often considered to be a unitary operation, it may simply refer to the control of one or more selective processes, ideally in a co-ordinated way. While this view has some cost in terms of conceptual simplicity, it can help make sense of a large set of phenomena. -/- This article surveys several of the major issues in our understanding of attention and how it relates to perception. It focuses on vision, since many—if not all—considerations are similar for all sensory modalities, and the level of understanding achieved in this domain is currently the most advanced. (shrink)

Human vision briefly retains a trace of a stimulus after it disappears. This trace—iconic memory—is often believed to be a surrogate for the original stimulus, a representational structure that can be used as if the original stimulus were still present. To investigate its nature, a flicker-search paradigm was developed that relied upon a full scan (rather than partial report) of its contents. Results show that for visual search it can indeed act as a surrogate, with little cost for alternating between (...) visible and iconic representations. However, the duration over which it can be used depends on the type of task: some tasks can use iconic memory for at least 240 ms, others for only about 190 ms, while others for no more than about 120 ms. The existence of these different limits suggests that iconic memory may have multiple layers, each corresponding to a particular level of the visual hierarchy. In this view, the inability to use a layer of iconic memory may reflect an inability to maintain feedback connections to the corresponding representation. (shrink)

The task of visual search is to determine as rapidly as possible whether a target item is present or absent in a display. Rapidly detected items are thought to contain features that correspond to primitive elements in the human visual system. In previous theories, it has been assumed that visual search is based on simple two-dimensional features in the image. However, visual search also has access to another level of representation, one that describes properties in the corresponding three-dimensional scene. Among (...) these properties are three dimensionality and the direction of lighting, but not viewing direction. These findings imply that the parallel processes of early vision are much more sophisticated than previously assumed. (shrink)

“Pick a card, any card. This has to be a completely free choice.” the magician tells you. But is it really? Although we like to think that we are using our free will to make our decisions, research in psychology has shown that many of our behaviours are automatic and unconsciously influenced by external stimuli (Ariely, 2008; Bargh & Chartrand, 1999; Newell & Shanks, 2014; Nisbett & Wilson, 1977), and that we are often oblivious to the cognitive mechanisms that underpin (...) our decision (Wegner, 2002, 2003). Magicians have exploited this illusory sense of agency for a long time, and have developed a wide range of techniques to influence and control spectators’ choices of such things as card, word, or number (Annemann, 1933; Banachek, 2002a; Jones, 1994; Turner, 2015). These techniques are instances of what is called forcing. -/- Many forces are extremely effective, illustrating various weaknesses in our sense of control over decisions and their outcomes. Researchers have started to investigate them in various ways (Kuhn, Pailh s, & Lan, 2020; Olson, Amlani, Raz, & Rensink, 2015; Pailhes & Kuhn, 2020b, 2020c; Shalom et al., 2013) and are beginning to obtain valuable insights into decision-making processes as well as a better understanding of the cognitive mechanisms that lead people to experience an illusory sense of free will and of agency. -/- Although magicians have acquired large amounts of knowledge in covertly controlling people’s choices, much of this knowledge is only discussed in the context of individual magic tricks, or in books that are not readily accessible to non-magicans. As we and others have argued elsewhere (Ekroll, Sayim, & Wagemans, 2017; Kuhn, 2019; Kuhn, Amlani, & Rensink, 2008; Kuhn, Caffaratti, Teszka, & Rensink, 2014; Macknik et al., 2008; Olson et al., 2015; Olson, Landry, Appourchaux, & Raz, 2016; Shalom et al., 2013; Thomas, Didierjean, Maquestiaux, & Gygax, 2015), a particularly effective way of making this knowledge more available is via the creation of taxonomies centered around psychological mechanisms (Rensink & Kuhn, 2015). For example, the psychologically based taxonomy of misdirection (Kuhn et al., 2014) helps draw links between misdirection and formal theories of perception and cognition. -/- Our aim here is to apply a similar process to the knowledge magicians have about forcing. The present paper develops a psychologically based taxonomy of forcing techniques with two goals in mind. Firstly, it should help uncover the various psychological mechanisms that underlie forcing techniques. Secondly, it should facilitate knowledge transfer between magicians and psychologists. Among other things, this knowledge will allow researchers to gain new insights into the mechanisms underlying decision-making, and the feeling of free will and of agency over choice. We start by defining the magician’s force and then look at some of the past classifications of forcing. (shrink)

Forcing occurs when a magician influences the audience's decisions without their awareness. To investigate the mechanisms behind this effect, we examined several stimulus and personality predictors. In Study 1, a magician flipped through a deck of playing cards while participants were asked to choose one. Although the magician could influence the choice almost every time (98%), relatively few (9%) noticed this influence. In Study 2, participants observed rapid series of cards on a computer, with one target card shown longer than (...) the rest. We expected people would tend to choose this card without noticing that it was shown longest. Both stimulus and personality factors predicted the choice of card, depending on whether the influence was noticed. These results show that combining real-world and laboratory research can be a powerful way to study magic and can provide new methods to study the feeling of free will. (shrink)

Over the centuries, magicians have developed extensive knowledge about the manipulation of the human mind—knowledge that has been largely ignored by psychology. It has recently been argued that this knowledge could help improve our understanding of human cognition and consciousness. But how might this be done? And how much could it ultimately contribute to the exploration of the human mind? We propose here a framework outlining how knowledge about magic can be used to help us understand the human mind. Various (...) approaches—both old and new—are surveyed, in terms of four different levels. The first focuses on the methods in magic, using these to suggest new approaches to existing issues in psychology. The second focuses on the effects that magic can produce, such as the sense of wonder induced by seeing an apparently impossible event. Third is the consideration of magic tricks—methods and effects together—as phenomena of scientific interest in their own right. Finally, there is the organization of knowledge about magic into an informative whole, including the possibility of a science centered around the experience of wonder. (shrink)

Our perceptual experience is largely based on prediction, and as such can be influenced by knowledge of forthcoming events. This susceptibility is commonly exploited by magicians. In the Vanishing Ball Illusion, for example, a magician tosses a ball in the air a few times and then pretends to throw the ball again, whilst secretly concealing it in his hand. Most people claim to see the ball moving upwards and then vanishing, even though it did not leave the magician’s hand (Kuhn (...) & Land, 2006; Triplett, 1900). But what exactly can such illusions tell us? We investigated here whether seeing a real action before the pretend one was necessary for the Vanishing Ball Illusion. Participants either saw a real action immediately before the fake one, or only a fake action. Nearly one third of participants experienced the illusion with the fake action alone, while seeing the real action beforehand enhanced this effect even further. Our results therefore suggest that perceptual experience relies both on long-term knowledge of what an action should look like, as well as exemplars from the immediate past. In addition, whilst there was a forward displacement of perceived location in perceptual experience, this was not found for oculomotor responses, consistent with the proposal that two separate systems are involved in visual perception. (shrink)

We show that cast shadows can have a significant influence on the speed of visual search. In particular, we find that search based on the shape of a region is affected when the region is darker than the background and corresponds to a shadow formed by lighting from above. Results support the proposal that an early-level system rapidly identifies regions as shadows and then discounts them, making their shapes more difficult to access. Several constraints used by this system are mapped (...) out, including constraints on the luminance and texture of the shadow region, and on the nature of the item casting the shadow. Among other things, this system is found to distinguish between line elements (items containing only edges) and surface elements (items containing visible surfaces), with only the latter deemed capable of casting a shadow. (shrink)

For scatterplots with gaussian distributions of dots, the perception of Pearson correlation r can be described by two simple laws: a linear one for discrimination, and a logarithmic one for perceived magnitude (Rensink & Baldridge, 2010). The underlying perceptual mechanisms, however, remain poorly understood. To cast light on these, four different distributions of datapoints were examined. The first had 100 points with equal variance in both dimensions. Consistent with earlier results, just noticeable difference (JND) was a linear function of the (...) distance away from r = 1, and the magnitude of perceived correlation a logarithmic function of this quantity. In addition, these laws were linked, with the intercept of the JND line being the inverse of the bias in perceived magnitude. Three other conditions were also examined: a dot cloud with 25 points, a horizontal compression of the cloud, and a cloud with a uniform distribution of dots. Performance was found to be similar in all conditions. The generality and form of these laws suggest that what underlies correlation perception is not a geometric structure such as the shape of the dot cloud, but the shape of the probability distribution of the dots, likely inferred via a form of ensemble coding. It is suggested that this reflects the ability of observers to perceive the information entropy in an image, with this quantity used as a proxy for Pearson correlation. (shrink)

In the not-too-distant past, vision was often said to involve three levels of processing: a low level concerned with descriptions of the geometric and photometric properties of the image, a high level concerned with abstract knowledge of the physical and semantic properties of the world, and a middle level concerned with anything not handled by the other two. The negative definition of mid-level vision contained in this description reflected a rather large gap in our understanding of visual processing: How could (...) the here-and-now descriptions of the low levels combine with the enduring knowledge of the high levels to produce our perception of the surrounding world? A number of experimental and theoretical efforts have been made over the past few decades to solve this "mid-level crisis". One of the more recent of these is based on the phenomenon of change blindness—the difficulty in seeing a large change in a scene when the transients accompanying that change no longer convey information about its location (Rensink, O'Regan, & Clark, 1997; Rensink, 2000a). Phenomenologically, this effect is quite striking: the change typically is not seen for several seconds, after which it suddenly snaps into awareness. During the time the change remains "invisible", there is an apparent disconnection of the low-level descriptions (which respond to the change) from subjective visual experience (which does not). As such, this effect would seem to have the potential to help us understand how mid-level mechanisms might knit low- and high-level processes into a coherent representation of our surroundings. -/- It is argued here that this potential can indeed be realized, and that change blindness can teach us much about the nature of mid-level vision.3 A number of studies are first reviewed showing that the perception of a scene does not involve a steady buildup of detailed representation: rather, it is a dynamic process, with focused attention playing one of the main roles, viz., forming coherent object representations whenever needed. It is then argued that change blindness can also shed considerable light on the nature of focused attention itself, such as its speed, capacity, selectivity, and ability to bind together visual properties into coherent structures. (shrink)

Previous theories of early vision have assumed that visual search is based on simple two-dimensional aspects of an image, such as the orientation of edges and lines. It is shown here that search can also be based on three-dimensional orientation of objects in the corresponding scene, provided that these objects are simple convex blocks. Direct comparison shows that image-based and scene-based orientation are similar in their ability to facilitate search. These findings support the hypothesis that scene-based properties are represented at (...) preattentive levels in early vision. (shrink)

Several studies (e.g., Becklen & Cervone, 1983; Mack & Rock, 1998; Neisser & Becklen, 1975) have found that observers attending to a particular object or event often fail to report the presence of unexpected items. This has been interpreted as inattentional blindness (IB), a failure to see unattended items (Mack & Rock, 1998). Meanwhile, other studies (e.g., Pashler, 1988; Phillips, 1974; Rensink et al., 1997; Simons, 1996) have found that observers often fail to report the presence of large changes in (...) a display when these changes occur simultaneously with a transient such as an eye movement or flash of the display. This has been interpreted as change blindness (CB), a failure to see unattended changes (Rensink et al., 1997). In both cases there is a striking failure to report an object or event that would be quite visible under other circumstances. And in both cases there is a widespread (although not universal) belief that the underlying cause has to do with the absence of attention. The question then arises as to how these effects might be related. Is CB the same thing as IB? If not, what is the relation between them? And given that these phenomena deal with failures of subjective perception, what can they teach us about the nature of our visual experience? In particular, what can they teach us about the role played by visual attention? (shrink)

Ideomotor actions are behaviours that are unconsciously initiated and express a thought rather than a response to a sensory stimulus. The question examined here is whether ideomotor actions can also express nonconscious knowledge. We investigated this via the use of implicit long-term semantic memory, which is not available to conscious recall. We compared accuracy of answers to yes/no questions using both volitional report and ideomotor response . Results show that when participants believed they knew the answer, responses in the two (...) modalities were similar. But when they believed they were guessing, accuracy was at chance for volitional report , but significantly higher for Ouija response . These results indicate that implicit semantic memory can be expressed through ideomotor actions. They also suggest that this approach can provide an interesting new methodology for studying implicit processes in cognition. (shrink)

A computational theory is developed that explains how line drawings of polyhedral objects can be interpreted rapidly and in parallel at early levels of human vision. The key idea is that a time-limited process can correctly recover much of the three-dimensional structure of these objects when split into concurrent streams, each concerned with a single aspect of scene structure.

G. Francis and F. Hermens (2002) used computer simulations to claim that many current models of metacontrast masking can account for the findings of V. Di Lollo, J. T. Enns, and R. A. Rensink (2000). They also claimed that notions of reentrant processing are not necessary because all of V. Di Lollo et al. 's data can be explained by feed-forward models. The authors show that G. Francis and F. Hermens's claims are vitiated by inappropriate modeling of attention and by (...) ignoring important aspects of V. Di Lollo et al. 's results. (shrink)

This paper explores the extent to which a scientific framework for visualization might be possible. It presents several potential parts of a framework, illustrated by application to the visualization of correlation in scatterplots. The first is an extended-vision thesis, which posits that a viewer and visualization system can be usefully considered as a single system that perceives structure in a dataset, much like "basic" vision perceives structure in the world. This characterization is then used to suggest approaches to evaluation that (...) take advantage of techniques used in vision science. Next, an optimal-reduction thesis is presented, which posits that an optimal visualization enables the given task to be reduced to the most suitable operations in the extended system. A systematic comparison of alternative designs is then proposed, guided by what is known about perceptual mechanisms. It is shown that these elements can be extended in various ways—some even overlapping with parts of vision science. As such, a science of some kind appears possible for at least some parts of visualization. It would remain distinct from design practice, but could nevertheless assist with the design of visualizations that better engage human perception and cognition. (shrink)

The past few years have seen a resurgence of interest in the scientific study of magic. Despite being only a few years old, this “new wave” has already resulted in a host of interesting studies, often using methods that are both powerful and original. These developments have largely borne out our earlier hopes (Kuhn et al., 2008) that new opportunities were available for scientific studies based on the use of magic. And it would seem that much more can still be (...) done along these lines. -/- But in addition to this, we also suggested that it might be time to consider developing an outright science of magic—a distinct area of study concerned with the experience of wonder that results from encountering an apparently impossible event1. To this end, we proposed a framework as to how this might be achieved (Rensink and Kuhn, 2015). A science can be viewed as a systematic method of investigation involving three sets of issues: (i) the entities considered relevant, (ii) the kinds of questions that can be asked about them, and (iii) the kinds of answers that are legitimate (Kuhn, 1970). In the case of magic, we suggested that this could be done at three different levels, each focusing on a distinct set of issues concerned with the nature of magic itself: (i) the nature of magical experience, (ii) how individual magic tricks create this experience, and (iii) organizing knowledge of the set of known tricks in a more comprehensive way (Rensink and Kuhn, 2015). Our framework also included a base level focused on how the methods of magic could be used as tools to investigate issues in existing fields of study. -/- Lamont (2010) and Lamont et al. (2010) raised a number of concerns about the possibility of such a science, which we have addressed (Rensink and Kuhn, 2015). More recently, Lamont (2015) raised a new objection, arguing that although base-level work (i.e., applications of magic methods) might be useful, there is too little structure in magic tricks for them to be studied in a systematic way at the other levels, ruling out a science of magic. We argue here, however, that although this concern raises some interesting challenges for this science, it does not negate the possibility that it could exist, and could contribute to the study of the mind. (shrink)

This paper discusses several key issues concerning consciousness and human vision. A brief overview is presented of recent developments in this area, including issues that have been resolved and issues that remain unsettled. Based on this, three Hilbert questions are proposed. These involve three related sets of issues: the kinds of visual experience that exist, the kinds of visual attention that exist, and the ways that these relate to each other.

Our recent opinion article [1] examined what change blindness can and cannot tell us about visual representations. Among other things, we argued that change blindness can tell us a lot about how visual representations can be used, but little about their extent. We and others found the ‘sparse representations’ view appealing (and still do), and initially made the overly strong claim that change blindness supports the conclusion of sparse representations [2,3]. We wrote our article because change blindness continues to be (...) taken as evidence for sparse – or even absent – representations, and we used O’Regan and Noë’s influential paper [4] as an example. However, as has been noted for some time [5–8], this conclusion is logically flawed: lack of ability need not be caused by lack of representation. (shrink)

Selective access and integration underlie much of our visual experience. This article describes several of the experimental techniques used to investigate these processes, and some of the major results achieved in our understanding of their operation.

We present a rigorous way to evaluate the visual perception of correlation in scatterplots, based on classical psychophysical methods originally developed for simple properties such as brightness. Although scatterplots are graphically complex, the quantity they convey is relatively simple. As such, it may be possible to assess the perception of correlation in a similar way. Scatterplots were each of 5.0 extent, containing 100 points with a bivariate normal distribution. Means were 0.5 of the range of the points, and standard deviations (...) 0.2 of this range. Precision was determined via an adaptive algorithm to find the just noticeable differences (jnds) in correlation, i.e., the difference between two side-by-side scatterplots that could be discriminated 75% of the time. Accuracy was measured by direct estimation, using reference scatterplots with fixed upper and lower values, with a test scatterplot adjusted so that its correlation appeared to be halfway between these. This process was recursively applied to yield several further estimates. Results of the discrimination tests show jnd(r) = k (1/b – r), where r is the Pearson correlation, and parameters 0 < k, b < 1. Integration yields a subjective estimate of correlation g(r) = ln(1 – br) / ln(1– b). The values of b found via discrimination closely match those found via direct estimation. As such, it appears that the perception of correlation in a scatterplot is completely described by two related performance curves, specified by two easily-measured parameters. (shrink)

One of the more compelling beliefs about vision is that it is based on representations that are coherent and complete, with everything in the visual field described in great detail. However, changes made during a visual disturbance are found to be difficult to see, arguing against the idea that our brains contain a detailed, picture-like representation of the scene. Instead, it is argued here that a more dynamic, "just-in-time" representation is involved, one with deep similarities to the way that users (...) interact with external displays. It is further argued that these similarities can provide a basis for the design of intelligent display systems that can interact with humans in highly effective and novel ways. (shrink)

As observers, we generally have a strong impression of seeing everything in front of us at any moment. But compelling as it is, this impression is false – there are severe limits to what we can consciously experience in everyday life. Much of the evidence for this claim has come from two phenomena: change blindness (CB) and inattentional blindness (IB). -/- CB refers to the failure of an observer to visually experience changes that are easily seen once noticed. This can (...) happen even if the changes are large, constantly repeat, and the observer has been informed that they will occur. A related phenomenon is IB – the failure to visually experience an object or event when attention is directed elsewhere. For example, observers may fail to notice an unexpected object that enters their visual field, even if this object is large, appears for several seconds, and has important consequences for the selection of action. -/- Both phenomena involve a striking failure to report an object or event that is easily seen once noticed. As such, both are highly counterintuitive, not only in the subjective sense that observers have difficulty believing they could fail so badly at seeing but also in the objective sense that these findings challenge many existing ideas about how we see. But as counterintuitive as these phenomena are, progress has been made in understanding them. Indeed, doing so has allowed us to better understand the limitations of human perception in everyday life and to gain new insights into how our visual systems create the picture of the world that we experience each moment our eyes are open. (shrink)

This article discusses several key issues concerning the study of attention and its relation to visual perception, with an emphasis on behavioral and experiential aspects. It begins with an overview of several classical works carried out in the latter half of the 20th century, such as the development of early filter and spotlight models of attention. This is followed by a survey of subsequent research that extended or modified these results in significant ways. It covers current work on various forms (...) of induced blindness and on the capabilities of nonattentional processes. It also includes proposals about how a "just-in-time" allocation of attention can create the impression that we see our surroundings in coherent detail everywhere, as well as how the failure of such allocation can result in various perceptual deficits. The final section examines issues that have received little consideration to date, but may be important for new lines of research in the near future. These include the prospects for a better characterization of attention, the possibility of more systematic explanations, factors that may significantly modulate attentional operation, and the possibility of several kinds of visual attention and visual experience. (shrink)

Rensink, O’Regan, and Clark (1997) drew attention to the phenomenon of change blindness, in which even large changes can be difficult to notice if made during the appearance of motion transients elsewhere in the image. This article provides a sketch of the events that inspired that article as well as its subsequent impact on psychological science and on society at large.

Visual analytics (VA) combines the strengths of human and machine intelligence to enable the discovery of interesting patterns in challenging datasets. Historically, most attention has been given to developing the machine component—for example, machine learning or the human-computer interface. However, it is also essential to develop the abilities of the analysts themselves, especially at the beginning of their careers. -/- For the past several years, we at the University of British Columbia (UBC)—with the support of The Boeing Company—have experimented with (...) various ways of preparing undergraduate students for VA. Although inspired by the need to prepare students to become visual analysts, the result turned out to be fairly general in scope, applicable to other analytical approaches, as well as more general research. In hindsight, this makes considerable sense. Although the visual component of VA is necessary, it is insufficient; many analytical activities at the human end involve nonvisual skills, such as effective decision-making and the ability to quickly focus on the relevant parts of a problem. -/- The result of this experimentation is a third-year undergraduate course titled Cognitive Systems 303 (COGS 303) that focuses on “VA unplugged”—that is, on developing investigative abilities prior to training on the VA systems themselves. It was felt that if students focused on developing basic analytical habits of thought prior to learning VA systems, these habits would be reinforced by subsequent practice on “live” systems. (shrink)

East Asians and Westerners differ in various aspects of perception and cognition. For example, visual memory for East Asians is believed to be more influenced by the contextual aspects of a scene than is the case for Westerners (Masuda & Nisbett, 2001). There are also differences in visual search: for Westerners, search for a long line among short is faster than for short among long, whereas this difference does not appear to hold for East Asians (Ueda et al., submitted). However, (...) it is unclear how these group-level differences originate. To investigate the extent to which they depend upon environment, we tested visual search and visual memory in East Asian immigrants who had lived in Canada for different amounts of time. Recent immigrants were found to exhibit no search asymmetry, unlike Westerners who had spent their lives in Canada. However, immigrants who had lived in Canada for more than two years showed performance comparable to that of Westerners. These differences could not be explained by the general analytic/holistic processing distinction believed to differentiate Westerners and East Asians, since all observers showed a strong holistic tendency for visual recognition. Results instead support the suggestion that exposure to a new environment can significantly affect the particular processes used to perceive a given stimulus. (shrink)

Recent developments in vision science have resulted in several major changes in our understanding of human visual perception. For example, attention no longer appears necessary for "visual intelligence"--a large amount of sophisticated processing can be done without it. Scene perception no longer appears to involve static, general-purpose descriptions, but instead may involve dynamic representations whose content depends on the individual and the task. And vision itself no longer appears to be limited to the production of a conscious "picture"--it may also (...) guide processes outside the conscious awareness of the observer. (shrink)

This chapter presents an overview of several recent developments in vision science, and outlines some of their implications for the management of visual attention in graphic displays. These include ways of sending attention to the right item at the right time, techniques to improve attentional efficiency, and possibilities for offloading some of the processing typically done by attention onto nonattentional mechanisms. In addition it is argued that such techniques not only allow more effective use to be made of visual attention, (...) but also open up new possibilities for human-machine interaction. (shrink)

Research over the past half century has produced extensive evidence that observers cannot report or retain all of the details of their visual world from one moment to the next. During the past decade, a new set of studies has illustrated just how pervasive these limits are. For example, early evidence for the failure to detect changes to simple dot patterns (Phillips, 1974) and arrays of letters (Pashler, 1988) generalizes to more naturalistic displays such as photographs and motion pictures (e.g., (...) Levin & Simons, 1997; Rensink, O’Regan, & Clark, 1997; see Rensink, 2002 for a recent review). This failure to report changes (change blindness) can be induced in both simple and naturalistic displays, whenever the change co-occurs with a visual disruption such as an eye movement (Currie, McConkie, Carlson-Radvansky, & Irwin, 1995; Hollingworth, Schrock, & Henderson, 2001), image shift (Blackmore, Brelstaff, Nelson, & Troscianko, 1995), flashed blank screen (Rensink et al., 1997), blink (O’Regan, Deubel, Clark, & Rensink, 2000), transient (O’Regan, Rensink, & Clark, 1999; Rensink, O’Regan, & Clark, 2000), movie cut or pan (Levin & Simons, 1997; Simons, 1996), or an occlusion event (Levin, Simons, Angelone, & Chabris, 2002; Simons & Levin, 1998). Change blindness can also occur in the absence of a disruption, provided the change occurs gradually enough that it does not attract attention (Simons, Franconeri, & Reimer, 2000). -/- Failures of visual awareness have been induced in a number of ways. For example, observers often fail to report a visible but unexpected stimulus when attention is focused on some other object or event in the display (inattentional blindness). As for change blindness, inattentional blindness occurs for both simple (Mack & Rock, 1998; Most et al., 2001) and naturalistic stimuli (Simons & Chabris, 1999). Similarly, repeated instances of an item often go undetected when embedded in a rapid sequence (repetition blindness), a phenomenon that occurs for both words and pictures (Kanwisher, 1987; Kanwisher & Potter, 1990). Observers can also fail to detect a stimulus in a rapid stream of stimuli provided they had to perform an attention-demanding task shortly before the stimulus appeared (Shapiro, Arnell, & Raymond, 1997). The surprisingly large variety of conditions that induce failures of conscious perception reinforces the broad conclusion that we are often unaware of what would otherwise be fully-visible stimuli. -/- Along with an increased appreciation of the limitations of visual awareness has come a renewed interest in using these limitations to explore the nature of the representations and processes underlying our visual experience. Are these limitations due to failures of perception? Of attention? Of memory? What is preserved with and without awareness? -/- The papers in this special issue of the Journal of Vision provide examples of exciting new work on induced failures of visual awareness and the mechanisms that underlie them. For example, several papers examine whether observers are drawn to parts of a display by the stimulus features or whether top-down control or semantic comprehension influence search through a display. Others investigate the nature of and limits on the information that is preserved from one view to the next and how much information needs to be retained for effective perception and action. As guest editors, we hope that this special issue will illustrate how studying the relationship between visual awareness and visual representations can lead to important new insights into the nature of seeing. (shrink)