When looking at a scene, observers feel that they see its entire structure in great detail and can immediately notice any changes in it. However, when brief blank fields are placed between alternating displays of an original and a modified scene, a striking failure of perception is induced: identification of changes becomes extremely difficult, even when changes are large and made repeatedly. Identification is much faster when a verbal cue is provided, showing that poor visibility is not the cause of (...) this difficulty. Identification is also faster for objects mentioned in brief verbal descriptions of the scene. These results support the idea that observers never form a complete, detailed representation of their surroundings. In addition, results also indicate that attention is required to perceive change, and that in the absence of localized motion signals it is guided on the basis of high-level interest. (shrink)

Five aspects of visual change detection are reviewed. The first concerns the concept of change itself, in particular the ways it differs from the related notions of motion and difference. The second involves the various methodological approaches that have been developed to study change detection; it is shown that under a variety of conditions observers are often unable to see large changes directly in their field of view. Next, it is argued that this “change blindness” indicates that focused attention is (...) needed to detect change, and that this can help map out the nature of visual attention. The fourth aspect concerns how these results affect our understanding of visual perception—for example, the implication that a sparse, dynamic representation underlies much of our visual experience. Finally, a brief discussion is presented concerning the limits to our current understanding of change detection. (shrink)

One of the more powerful impressions created by vision is that of a coherent, richly-detailed world where everything is present simultaneously. Indeed, this impression is so compelling that we tend to ascribe these properties not only to the external world, but to our internal representations as well. But results from several recent experiments argue against this latter ascription. For example, changes in images of real-world scenes often go unnoticed when made during a saccade, flicker, blink, or movie cut. This "change (...) blindness" provides strong evidence against the idea that our brains contain a picture-like representation of the scene that is everywhere detailed and coherent. (shrink)

Large changes that occur in clear view of an observer can become difficult to notice if made during an eye movement, blink, or other such disturbance. This change blindness is consistent with the proposal that focused visual attention is necessary to see change, with a change becoming difficult to notice whenever conditions prevent attention from being automatically drawn to it. -/- It is shown here how the phenomenon of change blindness can provide new results on the nature of visual attention, (...) including estimates of its capacity and the extent to which it can bind visual properties into coherent descriptions. It is also shown how the resultant characterization of attention can in turn provide new insights into the role that it plays in the perception of scenes and events. (shrink)

Large changes in a scene often become difficult to notice if made during an eye movement, image flicker, movie cut, or other such disturbance. It is argued here that this _change blindness_ can serve as a useful tool to explore various aspects of vision. This argument centers around the proposal that focused attention is needed for the explicit perception of change. Given this, the study of change perception can provide a useful way to determine the nature of visual attention, and (...) to cast new light on the way that it is?and is not?involved in visual perception. To illustrate the power of this approach, this paper surveys its use in exploring three different aspects of vision. The first concerns the general nature of _seeing_. To explain why change blindness can be easily induced in experiments but apparently not in everyday life, it is proposed that perception involves a _virtual representation_, where object representations do not accumulate, but are formed as needed. An architecture containing both attentional and nonattentional streams is proposed as a way to implement this scheme. The second aspect concerns the ability of observers to detect change even when they have no visual experience of it. This _sensing_ is found to take on at least two forms: detection without visual experience (but still with conscious awareness), and detection without any awareness at all. It is proposed that these are both due to the operation of a nonattentional visual stream. The final aspect considered is the nature of visual attention itself?the mechanisms involved when _scrutinizing_ items. Experiments using controlled stimuli show the existence of various limits on visual search for change. It is shown that these limits provide a powerful means to map out the attentional mechanisms involved. (shrink)

A set of visual search experiments tested the proposal that focused attention is needed to detect change. Displays were arrays of rectangles, with the target being the item that continually changed its orientation or contrast polarity. Five aspects of performance were examined: linearity of response, processing time, capacity, selectivity, and memory trace. Detection of change was found to be a self-terminating process requiring a time that increased linearly with the number of items in the display. Capacity for orientation was found (...) to be about 5 items, a value comparable to estimates of attentional capacity. Observers were able to filter out both static and dynamic variations in irrelevant properties. Analysis also indicated a memory for previously-attended locations. These results support the hypothesis that the process needed to detect change is much the same as the attentional process needed to detect complex static patterns. Interestingly, the features of orientation and polarity were found to be handled in somewhat different ways. Taken together, these results not only provide evidence that focused attention is needed to see change, but also show that change detection itself can provide new insights into the nature of attentional processing. (shrink)

Experiments are presented showing that visual search for Mueller-Lyer (ML) stimuli is based on complete configurations, rather than component segments. Segments easily detected in isolation were difficult to detect when embedded in a configuration, indicating preemption by low-level groups. This preemption—which caused stimulus components to become inaccessible to rapid search—was an all-or-nothing effect, and so could serve as a powerful test of grouping. It is shown that these effects are unlikely to be due to blurring by simple spatial filters at (...) early visual levels. It is proposed instead that they are due to more sophisticated processes that rapidly bind contour fragments into spatially-extended assemblies. These results support the view that rapid visual search cannot access the primitives formed at the earliest stages of visual processing; rather, it can access only higher-level, more ecologically-relevant structures. (shrink)

It has often been assumed that when we use vision to become aware of an object or event in our surroundings, this must be accompanied by a corresponding visual experience (i.e., seeing). The studies reported here show that this assumption is incorrect. When observers view a sequence of displays alternating between an image of a scene and the same image changed in some way, they often feel (or sense) the change even though they have no visual experience of it. The (...) subjective difference between sensing and seeing is mirrored in several behavioral differences, suggesting that these are two distinct modes of conscious visual perception. (shrink)

It is suggested that the relationship between visual attention and conscious visual experience can be simplified by distinguishing different aspects of both visual attention and visual experience. A set of principles is first proposed for any possible taxonomy of the processes involved in visual attention. A particular taxonomy is then put forward that describes five such processes, each with a distinct function and characteristic mode of operation. Based on these, three separate kinds—or possibly grades—of conscious visual experience can be distinguished, (...) each associated with a particular combination of attentional processes. (shrink)

When brief blank fields are placed between alternating displays of an original and a modified scene, a striking failure of perception is induced: the changes become extremely difficult to notice, even when they are large, presented repeatedly, and the observer expects them to occur (Rensink, O'Regan, & Clark, 1997). To determine the mechanisms behind this induced "change blindness", four experiments examine its dependence on initial preview and on the nature of the interruptions used. Results support the proposal that representations (...) at the early stages of visual processing are highly volatile, and that focused attention is needed to stabilize them sufficiently to support the perception of change. (shrink)

Over the centuries, magicians have developed extensive knowledge about the manipulation of the human mind—knowledge that has been largely ignored by psychology. It has recently been argued that this knowledge could help improve our understanding of human cognition and consciousness. But how might this be done? And how much could it ultimately contribute to the exploration of the human mind? We propose here a framework outlining how knowledge about magic can be used to help us understand the human mind. Various (...) approaches—both old and new—are surveyed, in terms of four different levels. The first focuses on the methods in magic, using these to suggest new approaches to existing issues in psychology. The second focuses on the effects that magic can produce, such as the sense of wonder induced by seeing an apparently impossible event. Third is the consideration of magic tricks—methods and effects together—as phenomena of scientific interest in their own right. Finally, there is the organization of knowledge about magic into an informative whole, including the possibility of a science centered around the experience of wonder. (shrink)

We show that early vision can use monocular cues to rapidly complete partially-occluded objects. Visual search for easily detected fragments becomes difficult when the completed shape is similar to others in the display; conversely, search for fragments that are difficult to detect becomes easy when the completed shape is distinctive. Results indicate that completion occurs via the occlusion-triggered removal of occlusion edges and linking of associated regions. We fail to find evidence for a visible filling-in of contours or surfaces, but (...) do find evidence for a "functional" filling-in that prevents the constituent fragments from being rapidly accessed. As such, it is only the completed structures—and not the fragments themselves—that serve as the basis for rapid recognition. (shrink)

Our visual experience of the world is one of diverse objects and events, each with particular colors, shapes, and motions. This experience is so coherent, so immediate, and so effortless that it seems to result from a single system that lets us experience everything in our field of view. But however appealing, this belief is mistaken: there are severe limits on what can be visually experienced. -/- For example, in a display for air-traffic control it is important to track all (...) moving items. For a single item, this can be done without problem. Three or four can also be tracked, although some degree of effort may be needed. As the number is increased further, accurate tracking becomes more and more difficult—and eventually, impossible. Performance is evidently affected by a factor within the observer which enables certain kinds of perception to occur, but is limited in some way. This factor is generally referred to as attention. -/- At various times, attention has been associated with clarity of perception, intensity of perception, consciousness, selection, or the allocation of a limited “resource” enabling various operations (see Hatfield, 1998). During the past several decades, considerable progress has been achieved by focusing on the idea of selection (Broadbent, 1982). In particular, attention can be productively viewed as contingently selective processing. This can be embodied in various ways by various processes—there need not be a single quantity identified with all forms of attention, or a single site where it operates (Allport, 1993; Tsotsos, 2011). Although “paying attention” is often considered to be a unitary operation, it may simply refer to the control of one or more selective processes, ideally in a co-ordinated way. While this view has some cost in terms of conceptual simplicity, it can help make sense of a large set of phenomena. -/- This article surveys several of the major issues in our understanding of attention and how it relates to perception. It focuses on vision, since many—if not all—considerations are similar for all sensory modalities, and the level of understanding achieved in this domain is currently the most advanced. (shrink)

Human vision briefly retains a trace of a stimulus after it disappears. This trace—iconic memory—is often believed to be a surrogate for the original stimulus, a representational structure that can be used as if the original stimulus were still present. To investigate its nature, a flicker-search paradigm was developed that relied upon a full scan (rather than partial report) of its contents. Results show that for visual search it can indeed act as a surrogate, with little cost for alternating between (...) visible and iconic representations. However, the duration over which it can be used depends on the type of task: some tasks can use iconic memory for at least 240 ms, others for only about 190 ms, while others for no more than about 120 ms. The existence of these different limits suggests that iconic memory may have multiple layers, each corresponding to a particular level of the visual hierarchy. In this view, the inability to use a layer of iconic memory may reflect an inability to maintain feedback connections to the corresponding representation. (shrink)

Traditionally, vision science and information/data visualization have interacted by using knowledge of human vision to help design effective displays. It is argued here, however, that this interaction can also go in the opposite direction: the investigation of successful visualizations can lead to the discovery of interesting new issues and phenomena in visual perception. Various studies are reviewed showing how this has been done for two areas of visualization, namely, graphical representations and interaction, which lend themselves to work on visual processing (...) and the control of visual operations, respectively. The results of these studies have provided new insights into aspects of vision such as grouping, attentional selection and the sequencing of visual operations. More generally yet, such results support the view that the perception of visualizations can be a useful domain for exploring the nature of visual cognition, inspiring new kinds of questions as well as casting new light on the limits to which information can be conveyed visually. (shrink)

We show that cast shadows can have a significant influence on the speed of visual search. In particular, we find that search based on the shape of a region is affected when the region is darker than the background and corresponds to a shadow formed by lighting from above. Results support the proposal that an early-level system rapidly identifies regions as shadows and then discounts them, making their shapes more difficult to access. Several constraints used by this system are mapped (...) out, including constraints on the luminance and texture of the shadow region, and on the nature of the item casting the shadow. Among other things, this system is found to distinguish between line elements (items containing only edges) and surface elements (items containing visible surfaces), with only the latter deemed capable of casting a shadow. (shrink)

The past few years have seen a resurgence of interest in the scientific study of magic. Despite being only a few years old, this “new wave” has already resulted in a host of interesting studies, often using methods that are both powerful and original. These developments have largely borne out our earlier hopes (Kuhn et al., 2008) that new opportunities were available for scientific studies based on the use of magic. And it would seem that much more can still be (...) done along these lines. -/- But in addition to this, we also suggested that it might be time to consider developing an outright science of magic—a distinct area of study concerned with the experience of wonder that results from encountering an apparently impossible event1. To this end, we proposed a framework as to how this might be achieved (Rensink and Kuhn, 2015). A science can be viewed as a systematic method of investigation involving three sets of issues: (i) the entities considered relevant, (ii) the kinds of questions that can be asked about them, and (iii) the kinds of answers that are legitimate (Kuhn, 1970). In the case of magic, we suggested that this could be done at three different levels, each focusing on a distinct set of issues concerned with the nature of magic itself: (i) the nature of magical experience, (ii) how individual magic tricks create this experience, and (iii) organizing knowledge of the set of known tricks in a more comprehensive way (Rensink and Kuhn, 2015). Our framework also included a base level focused on how the methods of magic could be used as tools to investigate issues in existing fields of study. -/- Lamont (2010) and Lamont et al. (2010) raised a number of concerns about the possibility of such a science, which we have addressed (Rensink and Kuhn, 2015). More recently, Lamont (2015) raised a new objection, arguing that although base-level work (i.e., applications of magic methods) might be useful, there is too little structure in magic tricks for them to be studied in a systematic way at the other levels, ruling out a science of magic. We argue here, however, that although this concern raises some interesting challenges for this science, it does not negate the possibility that it could exist, and could contribute to the study of the mind. (shrink)

Several studies (e.g., Becklen & Cervone, 1983; Mack & Rock, 1998; Neisser & Becklen, 1975) have found that observers attending to a particular object or event often fail to report the presence of unexpected items. This has been interpreted as inattentional blindness (IB), a failure to see unattended items (Mack & Rock, 1998). Meanwhile, other studies (e.g., Pashler, 1988; Phillips, 1974; Rensink et al., 1997; Simons, 1996) have found that observers often fail to report the presence of large changes (...) in a display when these changes occur simultaneously with a transient such as an eye movement or flash of the display. This has been interpreted as change blindness (CB), a failure to see unattended changes (Rensink et al., 1997). In both cases there is a striking failure to report an object or event that would be quite visible under other circumstances. And in both cases there is a widespread (although not universal) belief that the underlying cause has to do with the absence of attention. The question then arises as to how these effects might be related. Is CB the same thing as IB? If not, what is the relation between them? And given that these phenomena deal with failures of subjective perception, what can they teach us about the nature of our visual experience? In particular, what can they teach us about the role played by visual attention? (shrink)

In the not-too-distant past, vision was often said to involve three levels of processing: a low level concerned with descriptions of the geometric and photometric properties of the image, a high level concerned with abstract knowledge of the physical and semantic properties of the world, and a middle level concerned with anything not handled by the other two. The negative definition of mid-level vision contained in this description reflected a rather large gap in our understanding of visual processing: How could (...) the here-and-now descriptions of the low levels combine with the enduring knowledge of the high levels to produce our perception of the surrounding world? A number of experimental and theoretical efforts have been made over the past few decades to solve this "mid-level crisis". One of the more recent of these is based on the phenomenon of change blindness—the difficulty in seeing a large change in a scene when the transients accompanying that change no longer convey information about its location (Rensink, O'Regan, & Clark, 1997; Rensink, 2000a). Phenomenologically, this effect is quite striking: the change typically is not seen for several seconds, after which it suddenly snaps into awareness. During the time the change remains "invisible", there is an apparent disconnection of the low-level descriptions (which respond to the change) from subjective visual experience (which does not). As such, this effect would seem to have the potential to help us understand how mid-level mechanisms might knit low- and high-level processes into a coherent representation of our surroundings. -/- It is argued here that this potential can indeed be realized, and that change blindness can teach us much about the nature of mid-level vision.3 A number of studies are first reviewed showing that the perception of a scene does not involve a steady buildup of detailed representation: rather, it is a dynamic process, with focused attention playing one of the main roles, viz., forming coherent object representations whenever needed. It is then argued that change blindness can also shed considerable light on the nature of focused attention itself, such as its speed, capacity, selectivity, and ability to bind together visual properties into coherent structures. (shrink)

It has generally been assumed that rapid visual search is based on simple features and that spatial relations between features are irrelevant for this task. Seven experiments involving search for line drawings contradict this assumption; a major determinant of search is the presence of line junctions. Arrow- and Y-junctions were detected rapidly in isolation and when they were embedded in drawings of rectangular polyhedra. Search for T-junctions was considerably slower. Drawings containing T-junctions often gave rise to very slow search even (...) when distinguishing arrow- or Y-junctions were present. This sensitivity to line relations suggests that preattentive processes can extract 3-dimensional orientation from line drawings. A computational model is outlined for how this may be accomplished in early human vision. (shrink)

A computational theory is developed that explains how line drawings of polyhedral objects can be interpreted rapidly and in parallel at early levels of human vision. The key idea is that a time-limited process can correctly recover much of the three-dimensional structure of these objects when split into concurrent streams, each concerned with a single aspect of scene structure.

Rensink, O’Regan, and Clark (1997) drew attention to the phenomenon of change blindness, in which even large changes can be difficult to notice if made during the appearance of motion transients elsewhere in the image. This article provides a sketch of the events that inspired that article as well as its subsequent impact on psychological science and on society at large.

This paper discusses several key issues concerning consciousness and human vision. A brief overview is presented of recent developments in this area, including issues that have been resolved and issues that remain unsettled. Based on this, three Hilbert questions are proposed. These involve three related sets of issues: the kinds of visual experience that exist, the kinds of visual attention that exist, and the ways that these relate to each other.

We present a rigorous way to evaluate the visual perception of correlation in scatterplots, based on classical psychophysical methods originally developed for simple properties such as brightness. Although scatterplots are graphically complex, the quantity they convey is relatively simple. As such, it may be possible to assess the perception of correlation in a similar way. Scatterplots were each of 5.0 extent, containing 100 points with a bivariate normal distribution. Means were 0.5 of the range of the points, and standard deviations (...) 0.2 of this range. Precision was determined via an adaptive algorithm to find the just noticeable differences (jnds) in correlation, i.e., the difference between two side-by-side scatterplots that could be discriminated 75% of the time. Accuracy was measured by direct estimation, using reference scatterplots with fixed upper and lower values, with a test scatterplot adjusted so that its correlation appeared to be halfway between these. This process was recursively applied to yield several further estimates. Results of the discrimination tests show jnd(r) = k (1/b – r), where r is the Pearson correlation, and parameters 0 < k, b < 1. Integration yields a subjective estimate of correlation g(r) = ln(1 – br) / ln(1– b). The values of b found via discrimination closely match those found via direct estimation. As such, it appears that the perception of correlation in a scatterplot is completely described by two related performance curves, specified by two easily-measured parameters. (shrink)

Selective access and integration underlie much of our visual experience. This article describes several of the experimental techniques used to investigate these processes, and some of the major results achieved in our understanding of their operation.

For scatterplots with gaussian distributions of dots, the perception of Pearson correlation r can be described by two simple laws: a linear one for discrimination, and a logarithmic one for perceived magnitude (Rensink & Baldridge, 2010). The underlying perceptual mechanisms, however, remain poorly understood. To cast light on these, four different distributions of datapoints were examined. The first had 100 points with equal variance in both dimensions. Consistent with earlier results, just noticeable difference (JND) was a linear function of (...) the distance away from r = 1, and the magnitude of perceived correlation a logarithmic function of this quantity. In addition, these laws were linked, with the intercept of the JND line being the inverse of the bias in perceived magnitude. Three other conditions were also examined: a dot cloud with 25 points, a horizontal compression of the cloud, and a cloud with a uniform distribution of dots. Performance was found to be similar in all conditions. The generality and form of these laws suggest that what underlies correlation perception is not a geometric structure such as the shape of the dot cloud, but the shape of the probability distribution of the dots, likely inferred via a form of ensemble coding. It is suggested that this reflects the ability of observers to perceive the information entropy in an image, with this quantity used as a proxy for Pearson correlation. (shrink)

This paper explores the extent to which a scientific framework for visualization might be possible. It presents several potential parts of a framework, illustrated by application to the visualization of correlation in scatterplots. The first is an extended-vision thesis, which posits that a viewer and visualization system can be usefully considered as a single system that perceives structure in a dataset, much like "basic" vision perceives structure in the world. This characterization is then used to suggest approaches to evaluation that (...) take advantage of techniques used in vision science. Next, an optimal-reduction thesis is presented, which posits that an optimal visualization enables the given task to be reduced to the most suitable operations in the extended system. A systematic comparison of alternative designs is then proposed, guided by what is known about perceptual mechanisms. It is shown that these elements can be extended in various ways—some even overlapping with parts of vision science. As such, a science of some kind appears possible for at least some parts of visualization. It would remain distinct from design practice, but could nevertheless assist with the design of visualizations that better engage human perception and cognition. (shrink)

One of the more compelling beliefs about vision is that it is based on representations that are coherent and complete, with everything in the visual field described in great detail. However, changes made during a visual disturbance are found to be difficult to see, arguing against the idea that our brains contain a detailed, picture-like representation of the scene. Instead, it is argued here that a more dynamic, "just-in-time" representation is involved, one with deep similarities to the way that users (...) interact with external displays. It is further argued that these similarities can provide a basis for the design of intelligent display systems that can interact with humans in highly effective and novel ways. (shrink)

As observers, we generally have a strong impression of seeing everything in front of us at any moment. But compelling as it is, this impression is false – there are severe limits to what we can consciously experience in everyday life. Much of the evidence for this claim has come from two phenomena: change blindness (CB) and inattentional blindness (IB). -/- CB refers to the failure of an observer to visually experience changes that are easily seen once noticed. This can (...) happen even if the changes are large, constantly repeat, and the observer has been informed that they will occur. A related phenomenon is IB – the failure to visually experience an object or event when attention is directed elsewhere. For example, observers may fail to notice an unexpected object that enters their visual field, even if this object is large, appears for several seconds, and has important consequences for the selection of action. -/- Both phenomena involve a striking failure to report an object or event that is easily seen once noticed. As such, both are highly counterintuitive, not only in the subjective sense that observers have difficulty believing they could fail so badly at seeing but also in the objective sense that these findings challenge many existing ideas about how we see. But as counterintuitive as these phenomena are, progress has been made in understanding them. Indeed, doing so has allowed us to better understand the limitations of human perception in everyday life and to gain new insights into how our visual systems create the picture of the world that we experience each moment our eyes are open. (shrink)

Four experiments investigated the extent to which abstract quantitative information can be conveyed by basic visual features. This was done by asking observers to estimate and discriminate Pearson correlation in graphical representations where the first data dimension of each element was encoded by its horizontal position, and the second by the value of one of its visual features; perceiving correlation then requires combining the information in the two encodings via a common abstract representation. Four visual features were examined: luminance, color, (...) orientation, and size. All were able to support the perception of correlation. Indeed, despite the strikingly different appearances of the associated stimuli, all gave rise to performance that was much the same: just noticeable difference was a linear function of distance from complete correlation, and estimated correlation a logarithmic function of this distance. Performance differed only in regards to the level of noise in the feature, with these values compatible with estimates of channel capacity encountered in classic experiments on absolute perceptual magnitudes. These results suggest that quantitative information can be conveyed by visual features that are abstracted at relatively low levels of visual processing, with little representation of the original sensory property. It is proposed that this is achieved via an abstract parameter space in which the values in each perceptual dimension are normalized to have the same means and variances, with perceived correlation based on the shape of the joint probability density function of the resultant elements. (shrink)

Focused attention is needed to perceive change (Rensink et al., 1997; Psychological Science, 8: 368-373) . But how much attentional processing is given to an item? And does this depend on the nature of the task? To answer these questions, "flicker" displays were created, where an original and a modified image continually alternated, with brief blanks between them. Each image was an array of simple figures, half being horizontal and the other half vertical. In half the trials, one of (...) the items changed orientation; in the remainder, all items remained the same. Observers were asked to detect whether a change was occurring in each trial. -/- Within-observer comparisons for different shapes of items yielded two classes of speed: relatively fast search (50 ms/item) for simple lines, and slower search (90 ms/item) for compound figures made of two or more lines. Evidently, more processing was given to compound figures, even though shape was irrelevant to the task. A similar set of experiments asked observers to detect changes in contrast polarity. Here, no differences were found for different shapes, indicating that geometric information is not processed as much when the task involves only nongeometric properties. (shrink)

This article discusses several key issues concerning the study of attention and its relation to visual perception, with an emphasis on behavioral and experiential aspects. It begins with an overview of several classical works carried out in the latter half of the 20th century, such as the development of early filter and spotlight models of attention. This is followed by a survey of subsequent research that extended or modified these results in significant ways. It covers current work on various forms (...) of induced blindness and on the capabilities of nonattentional processes. It also includes proposals about how a "just-in-time" allocation of attention can create the impression that we see our surroundings in coherent detail everywhere, as well as how the failure of such allocation can result in various perceptual deficits. The final section examines issues that have received little consideration to date, but may be important for new lines of research in the near future. These include the prospects for a better characterization of attention, the possibility of more systematic explanations, factors that may significantly modulate attentional operation, and the possibility of several kinds of visual attention and visual experience. (shrink)

Visual analytics (VA) combines the strengths of human and machine intelligence to enable the discovery of interesting patterns in challenging datasets. Historically, most attention has been given to developing the machine component—for example, machine learning or the human-computer interface. However, it is also essential to develop the abilities of the analysts themselves, especially at the beginning of their careers. -/- For the past several years, we at the University of British Columbia (UBC)—with the support of The Boeing Company—have experimented with (...) various ways of preparing undergraduate students for VA. Although inspired by the need to prepare students to become visual analysts, the result turned out to be fairly general in scope, applicable to other analytical approaches, as well as more general research. In hindsight, this makes considerable sense. Although the visual component of VA is necessary, it is insufficient; many analytical activities at the human end involve nonvisual skills, such as effective decision-making and the ability to quickly focus on the relevant parts of a problem. -/- The result of this experimentation is a third-year undergraduate course titled Cognitive Systems 303 (COGS 303) that focuses on “VA unplugged”—that is, on developing investigative abilities prior to training on the VA systems themselves. It was felt that if students focused on developing basic analytical habits of thought prior to learning VA systems, these habits would be reinforced by subsequent practice on “live” systems. (shrink)

Recent developments in vision science have resulted in several major changes in our understanding of human visual perception. For example, attention no longer appears necessary for "visual intelligence"--a large amount of sophisticated processing can be done without it. Scene perception no longer appears to involve static, general-purpose descriptions, but instead may involve dynamic representations whose content depends on the individual and the task. And vision itself no longer appears to be limited to the production of a conscious "picture"--it may also (...) guide processes outside the conscious awareness of the observer. (shrink)

Our perceptual experience is largely based on prediction, and as such can be influenced by knowledge of forthcoming events. This susceptibility is commonly exploited by magicians. In the Vanishing Ball Illusion, for example, a magician tosses a ball in the air a few times and then pretends to throw the ball again, whilst secretly concealing it in his hand. Most people claim to see the ball moving upwards and then vanishing, even though it did not leave the magician’s hand (Kuhn (...) & Land, 2006; Triplett, 1900). But what exactly can such illusions tell us? We investigated here whether seeing a real action before the pretend one was necessary for the Vanishing Ball Illusion. Participants either saw a real action immediately before the fake one, or only a fake action. Nearly one third of participants experienced the illusion with the fake action alone, while seeing the real action beforehand enhanced this effect even further. Our results therefore suggest that perceptual experience relies both on long-term knowledge of what an action should look like, as well as exemplars from the immediate past. In addition, whilst there was a forward displacement of perceived location in perceptual experience, this was not found for oculomotor responses, consistent with the proposal that two separate systems are involved in visual perception. (shrink)

Scene Perception is the visual perception of an environment as viewed by an observer at any given time. It includes not only the perception of individual objects, but also such things as their relative locations, and expectations about what other kinds of objects might be encountered. -/- Given that scene perception is so effortless for most observers, it might be thought of as something easy to understand. However, the amount of effort required by a process often bears little relation to (...) its underlying complexity. A closer look shows that scene perception is a highly complex activity, and that any account of it must deal with several difficult issues: What exactly is a scene? What aspects of it do we represent? And what are the processes involved? Finding the answers to these questions has proven to be extraordinarily difficult. (shrink)

Ideomotor actions are behaviours that are unconsciously initiated and express a thought rather than a response to a sensory stimulus. The question examined here is whether ideomotor actions can also express nonconscious knowledge. We investigated this via the use of implicit long-term semantic memory, which is not available to conscious recall. We compared accuracy of answers to yes/no questions using both volitional report and ideomotor response . Results show that when participants believed they knew the answer, responses in the two (...) modalities were similar. But when they believed they were guessing, accuracy was at chance for volitional report , but significantly higher for Ouija response . These results indicate that implicit semantic memory can be expressed through ideomotor actions. They also suggest that this approach can provide an interesting new methodology for studying implicit processes in cognition. (shrink)

“Pick a card, any card. This has to be a completely free choice.” the magician tells you. But is it really? Although we like to think that we are using our free will to make our decisions, research in psychology has shown that many of our behaviours are automatic and unconsciously influenced by external stimuli (Ariely, 2008; Bargh & Chartrand, 1999; Newell & Shanks, 2014; Nisbett & Wilson, 1977), and that we are often oblivious to the cognitive mechanisms that underpin (...) our decision (Wegner, 2002, 2003). Magicians have exploited this illusory sense of agency for a long time, and have developed a wide range of techniques to influence and control spectators’ choices of such things as card, word, or number (Annemann, 1933; Banachek, 2002a; Jones, 1994; Turner, 2015). These techniques are instances of what is called forcing. -/- Many forces are extremely effective, illustrating various weaknesses in our sense of control over decisions and their outcomes. Researchers have started to investigate them in various ways (Kuhn, Pailh s, & Lan, 2020; Olson, Amlani, Raz, & Rensink, 2015; Pailhes & Kuhn, 2020b, 2020c; Shalom et al., 2013) and are beginning to obtain valuable insights into decision-making processes as well as a better understanding of the cognitive mechanisms that lead people to experience an illusory sense of free will and of agency. -/- Although magicians have acquired large amounts of knowledge in covertly controlling people’s choices, much of this knowledge is only discussed in the context of individual magic tricks, or in books that are not readily accessible to non-magicans. As we and others have argued elsewhere (Ekroll, Sayim, & Wagemans, 2017; Kuhn, 2019; Kuhn, Amlani, & Rensink, 2008; Kuhn, Caffaratti, Teszka, & Rensink, 2014; Macknik et al., 2008; Olson et al., 2015; Olson, Landry, Appourchaux, & Raz, 2016; Shalom et al., 2013; Thomas, Didierjean, Maquestiaux, & Gygax, 2015), a particularly effective way of making this knowledge more available is via the creation of taxonomies centered around psychological mechanisms (Rensink & Kuhn, 2015). For example, the psychologically based taxonomy of misdirection (Kuhn et al., 2014) helps draw links between misdirection and formal theories of perception and cognition. -/- Our aim here is to apply a similar process to the knowledge magicians have about forcing. The present paper develops a psychologically based taxonomy of forcing techniques with two goals in mind. Firstly, it should help uncover the various psychological mechanisms that underlie forcing techniques. Secondly, it should facilitate knowledge transfer between magicians and psychologists. Among other things, this knowledge will allow researchers to gain new insights into the mechanisms underlying decision-making, and the feeling of free will and of agency over choice. We start by defining the magician’s force and then look at some of the past classifications of forcing. (shrink)

A new proof is presented of Tsotsos' result that the VISUAL MATCH problem is NP-complete when no (high-level) constraints are imposed on the search space. Like the proof given by Tsotsos, it is based on the polynomial reduction of the NP-complete problem KNAPSACK to VISUAL MATCH. Tsotsos' proof, however, involves limited-precision real numbers, which introduces an extra degree of complexity to his treatment. The reduction of KNAPSACK to VISUAL MATCH presented here makes no use of limited-precision numbers, leading to a (...) simpler and more direct proof of the result. (shrink)

Stephen Few provides a nice overview of the reasons why we should design data visualizations to be effective, and why it’s important to understand human perception when doing so. In fact, he’s done this so well that I can’t add much to his arguments. But I can, however, push the basic message a bit further, out into the times before and after those he discusses. Out into areas that are not as well known, or not really developed, where new opportunities (...) and new dangers may lie…. (shrink)

An overview is presented of the ways that change blindness has been applied to the study of various issues in perception and cognition. Topics include mechanisms of change perception, allocation of attention, nonconscious perception, and cognitive beliefs. Recent work using change blindness to investigate these topics is surveyed, along with a brief discussion of some of the ways that these approaches may further develop over the next few years.

This chapter presents an overview of several recent developments in vision science, and outlines some of their implications for the management of visual attention in graphic displays. These include ways of sending attention to the right item at the right time, techniques to improve attentional efficiency, and possibilities for offloading some of the processing typically done by attention onto nonattentional mechanisms. In addition it is argued that such techniques not only allow more effective use to be made of visual attention, (...) but also open up new possibilities for human-machine interaction. (shrink)

Change blindness is the striking failure to see large changes that normally would be noticed easily. Over the past decade this phenomenon has greatly contributed to our understanding of attention, perception, and even consciousness. The surprising extent of change blindness explains its broad appeal, but its counterintuitive nature has also engendered confusions about the kinds of inferences that legitimately follow from it. Here we discuss the legitimate and the erroneous inferences that have been drawn, and offer a set of requirements (...) to help separate them. In doing so, we clarify the genuine contributions of change blindness research to our understanding of visual perception and awareness, and provide a glimpse of some ways in which change blindness might shape future research. (shrink)

This past decade has seen a great resurgence of interest in the perception of change. Change has, of course, long been recognized as a phenomenon worthy of study, and vision scientists have given their attention to it at various times in the past (for a review, see Rensink, 2002a). But things seem different this time around. This time, there is an emerging belief that instead of being just another visual ability, the perception of change may be something central to (...) our ‘visual life’, and that the mechanisms that underlie it may provide considerable insight into the operation of much of our visual system. This development may have been sparked by a number of factors: technology that allowed the easy creation of dynamic displays, a feeling in the air that it was time for something new, or it may have simply been a matter of chance. But once underway, this development was fueled by results, results that included both novel behavioral effects and new theoretical insights. Many of these centered around change blindness, the failure of observers to see large changes that are made contingent upon.. (shrink)

The capacity of visual attention/STM can be determined by change-detection experiments. Detecting the presence of change leads to an estimate of 4 items, while detecting the absence of change leads to an estimate of 1 item. Thus, there are two magical numbers in vision: 4 and 1. The underlying limits, however, are not necessarily those of central STM.

Knill, Kersten, & Mamassian (Chapter 6) provide an interesting discussion of how the Bayesian formulation can be used to help investigate human vision. In their view, computational theories can be based on an ideal observer that uses Bayesian inference to make optimal use of available information. Four factors are important here: the image information used, the output structures estimated, the priors assumed (i.e., knowledge about the structure of the world), and the likelihood function used (i.e., knowledge about the projection of (...) the world onto the sensors). Knill & Kersten argue that such a framework not only helps analyze a perceptual task, but can also help investigators to define it. Two examples are provided (the interpretation of surface contour and the perception of moving shadows) to show how this approach can be used in practice. As the authors admit, most (if not all) perceptual processes are ill-suited to a "strong" Bayesian approach based on a single consistent model of the world. Instead, they argue for a "weak" variant that assumes Bayesian inference to be carried out in modules of more limited scope. But how weak is "weak"? Are such approaches suitable for only a few relatively low-level tasks, or can they be applied more generally? Could a weak Bayesian approach, for example, explain how we would recognize the return of Elvis Presley? The formal modelling of human perception To help get a fix on things, it is useful to examine the fate of an earlier attempt to formalize human perception: the application of information theory. It was once hoped that this theory—a close cousin of the Bayesian formulation—would provide a way to uncover information-handling laws that were largely independent of physical implementation. In this approach, the human nervous system was assumed to have.. (shrink)

Recent advances in our understanding of visual perception have shown it to be a far more complex and counterintuitive process than previously believed. Several important consequences follow from this. First, the design of an effective statistical graphics system is unlikely to succeed based on intuition alone; instead, it must rely on a more sophisticated, systematic approach. The basic elements of such an approach are outlined here, along with several design principles. An overview is then given of recent advances in our (...) understanding of visual perception, including rapid perception, visual attention, and scene perception. It then is argued that the mechanisms involved can be successfully harnessed to allow data to be displayed more effectively than at present. Several directions of development are discussed, including effective use of visual attention, the display of dynamic information, and the effective use of nonattentional and nonconscious perceptual systems. (shrink)

Purpose. To determine whether highlights are rapidly identified at early levels of vision. -/- Methods. Visual search experiments were carried out using simple black and white figures corresponding to shiny objects lit from various directions. These included, for example, depictions of cylinders with highlights positioned at various heights (see figure). Targets and distractors differed only in the arrangement of their constituent regions, allowing them to be distinguished by the position of the highlights on the corresponding objects. -/- Results. Three observers (...) were tested. Search is rapid when the target corresponds to a shiny black object with a bottom highlight among objects with top highlights (view figure from rightside up). However, search slows down when the target corresponds to an object with a top highlight among objects with bottom highlights (view figure from upside down). This asymmetry in search speeds is destroyed when the contrast of the figures is reversed. -/- Conclusions. These results indicate that regions in the image can be rapidly identified as highlights at early levels of vision. They also suggest--as for several other rapid recovery processes--that an assumption of lighting from above is used as a simplifying constraint. (shrink)

This work investigates the ability of the human visual system to discriminate self-similar Gaussian random textures. The power spectra of such textures are similar to themselves when rescaled by some factor h > 1. As such, these textures provide a natural domain for testing the hypothesis that texture perception is based on a set of spatial-frequency channels characterized by filters of similar shape.