In this paper we offer a theory of cross-modal objects. To begin, we discuss two kinds of linkages between vision and audition. The first is a duality. The the visual system detects and identifies surfaces ; the auditory system detects and identifies sources . Surfaces are illuminated by sources of light; sound is reflected off surfaces. However, the visual system discounts sources and the auditory system discounts surfaces. These and similar considerations lead to the Theory of Indispensable Attributes (...) that states the conditions for the formation of gestalts in the two modalities. The second linkage involves the formation of audiovisual objects, integrated cross-modal experiences. We describe research that reveals the role of cross-modal causality in the formation of such objects. These experiments use the canonical example of a causal link between vision and audition: a visible impact that causes a percussive sound. (shrink)

The notion that visual attention can operate over visual objects in addition to spatial locations has recently received much empirical support, but there has been relatively little empirical consideration of what can count as an `object' in the ®rst place. We have investi- gated this question in the context of the multiple object tracking paradigm, in which subjects must track a number of independently and unpredictably moving identical items in a ®eld of identical distractors. What types (...) of feature clusters can be tracked in this manner? In other words, what counts as an `object' in this task? We investigated this question with a technique we call target merging: we alter tracking displays so that distinct target and distractor loca- tions appear perceptually to be parts of the same object by merging pairs of items (one target with one distractor) in various ways ± for example, by connecting item locations with a simple line segment, by drawing the convex hull of the two items, and so forth. The data show that target merging makes the tracking task far more dif®cult to varying degrees depending on exactly how the items are merged. The effect is perceptually salient, involving in some conditions a total destruction of subjects' capacity to track multiple items. These studies provide strong evidence for the object-based nature of tracking, con®rming that in some contexts attention must be allocated to objects rather than arbitrary collections of features. In addition, the results begin to reveal the types of spatially organized scene components that can be independently attended as a function of properties such as connectedness, part struc- ture, and other types of perceptual grouping. q 2001 Elsevier Science B.V. All rights reserved. (shrink)

Ordinary human perceivers know that visual objects are perceivable from standpoints other than their own. The aim of this paper is to provide an explanation of how perceptual experience equips perceivers with this knowledge. I approach the task by discussing a variety of action-based theories of perception. Some of these theories maintain that standpoint transcendence is required for shape perception. I argue that this standpoint transcendence must take place in the phenomenal present and that it can be explained in (...) terms of the experience of perceivers who jointly attend to an object. Joint perceivers experience objects as being perceived from standpoints other than their own. They operate in what I call “social space”, in which they single out objects by triangulating targets’ locations relative to their co-perceivers’ standpoints on these targets. It is then possible to explain the public character of the objects of individual experience by appeal to what I call “public space”. This is a spatial framework whose locations are presented as standpoints whence joint attention to the target would ensue, were they occupied by co-perceivers. If shape perception requires standpoint transcendence, then shape perceivers operate in public space and are thus capable of singling out targets by triangulating their locations from standpoints other than their own. If it doesn’t, then the introduction of a public spatial framework is an additional step whose introduction explains how perceivers come to experience objects as perceivable from standpoints other than their own. (shrink)

According to the traditional view, visual objects can be characterized as bundles of features and locations. This initially plausible idea is contested within the contemporary psychology and philosophy of perception, where it is claimed that the visual system can represent objects as merely ‘this’ or ‘that’, in abstraction from their qualities. In this paper, I consider whether philosophical and psychological arguments connected with the rejection of the ‘bundle’ view of visual objects show that it is needed to (...) postulate an additional, purely individualizing characteristic, known in the philosophical tradition as ‘thisness’, within the structure of visual objects. I argue that the phenomenon of asymmetry of errors observed in Multiple Object Tracking experiments strongly suggests that reference to ‘thisness’ is needed if we are to formulate a proper diachronic identity criterion of visual objects. (shrink)

The thesis that the visual system represents objects has garnered empirical support from a variety of sources in recent decades. But what kinds of things qualify as “objects” in the relevant sense? Are they ordinary three-dimensional bodies? Are they the facing surfaces of three-dimensional bodies? I argue that there is no fact of the matter: what we have are equally acceptable ways of assigning extensions to the relevant visual states. The view I defend bears obvious similarities to Quine’s (...) thesis that linguistic reference is inscrutable. Importantly, though, I argue that even if Quine was wrong about inscrutability as a thesis about language and thought, the case for the inscrutability of visual reference remains strong. (shrink)

While it is widely accepted that human vision represents objects, it is less clear which of the various philosophical notions of ‘object’ adequately characterizes visual objects. In this paper, I show that within contemporary cognitive psychology visual objects are characterized in two distinct, incompatible ways. On the one hand, models of visual organization describe visual objects in terms of combinations of features, in accordance with the philosophical bundle theories of objects. However, models of visual (...) persistence apply a notion of visual objects that is more similar to that endorsed in philosophical substratum theories. Here I discuss arguments that might show either that only one of the above notions of visual objects is adequate in the context of human vision, or that the category of visual objects is not uniform and contains entities properly characterized by different philosophical conceptions. (shrink)

One of the main functions of visual system is to construct representations of objects. These ‘visual objects’ are formed by developing the structure of more primitive visual representations. In the course of the article, I define the notions of ‘minimal visual object’, ‘maximal-non object representation’, and ‘constructing characteristic’ that differentiates minimal objects from maximal non-objects. Relying on these distinctions, I consider the type of ontological change that transforms visual regions, treated as maximal non- (...) class='Hi'>object representations, into basic, low-level visual objects. In order to identify such a change, theories of early vision, models of figure/ground distinction, and analytic, ontological notions of objects’ structure are discussed. Finally, a thesis is stated that external relations constitute the main structural factor that determines the ontological transition between non-object representations and visual objects. (shrink)

The papers by Macpherson, O'Callaghan, and Batty reveal some startling differences in the objects and properties represented by different modalities. They also reveal some tensions between different ways of understanding what it is for any one modality to represent objects and properties.

The target and background will change continuously in the long-term tracking process, which brings great challenges to the accurate prediction of targets. The correlation filter algorithm based on manual features is difficult to meet the actual needs due to its limited feature representation ability. Thus, to improve the tracking performance and robustness, an improved hierarchical convolutional features model is proposed into a correlation filter framework for visual object tracking. First, the objective function is designed by lasso regression modeling, (...) and a sparse, time-series low-rank filter is learned to increase the interpretability of the model. Second, the features of the last layer and the second pool layer of the convolutional neural network are extracted to realize the target position prediction from coarse to fine. In addition, using the filters learned from the first frame and the current frame to calculate the response maps, respectively, the target position is obtained by finding the maximum response value in the response map. The filter model is updated only when these two maximum responses meet the threshold condition. The proposed tracker is evaluated by simulation analysis on TC-128/OTB2015 benchmarks including more than 100 video sequences. Extensive experiments demonstrate that the proposed tracker achieves competitive performance against state-of-the-art trackers. The distance precision rate and overlap success rate of the proposed algorithm on OTB2015 are 0.829 and 0.695, respectively. The proposed algorithm effectively solves the long-term object tracking problem in complex scenes. (shrink)

: One can understand the word “object” as a concrete physical object or as that which is on the receiving end of a subject-object relation, namely, that entity which a particular cognitive state or process is “of.” These latter objects are determined by the way our sensory systems exploit the ways elements of the world impinge upon our bodily surfaces. Our visual system exploits light reflected off the surfaces of objects; therefore, the objects of our (...) class='Hi'>visual experiences can be physical objects just sitting still. Our auditory system, on the other hand, exploits sound waves caused by impacts of one sort or another, and these are events. You don’t, strictly speaking, hear a billiard ball or a car: You hear a billiard ball hit another one, or a car drive past. (shrink)

Visual Agnosia is a comprehensive and up-to-date review of disorders of higher vision that relates these disorders to current conceptions of higher vision from cognitive science, illuminating both the neuropsychological disorders and the nature of normal visual object recognition.Brain damage can lead to selective problems with visual perception, including visual agnosia the inability to recognize objects even though elementary visual functions remain unimpaired. Such disorders are relatively rare, yet they provide a window onto how (...) the normal brain might accomplish the complex task of vision. Visual Agnosia reviews a century of case studies of higher-level visual deficits following brain damage, places them in the general context of current neuroscience, and draws relevant conclusions about the organization of normal visual processing. It is unique in drawing on research in cognitive psychology, computational vision, visual neurophysiology, and neuropsychology to interpret the agnosias and draw inferences from them about visual object recognition.Following a historical account of agnosia research, Visual Agnosia offers a taxonomy of a wide range of agnosia syndromes, describing and interpreting the syndromes in terms of the latest theoretical models of visual processing and ultimately bringing them to bear as evidence on a variety of questions in the study of higher vision.Martha J. Farah is Associate Professor of Psychology at Carnegie Mellon University. Visual Agnosia is included in the Issues in Biology of Language and Cognition series, edited by John Marshall. (shrink)

We introduce a new version of the perceptual retouch model. This model was used for explaining properties of temporal interaction of successive objects in reaching conscious representation. The new model incorporates two interactive binding operations – binding features for objects and binding the bound feature-objects with a large scale oscillatory system that corresponds to perceptual consciousness. Here, the typical result of masking experiments – second object advantage in conscious perception – is achieved by applying the effects of a common (...) synchronizing oscillator with a delay. This delayed modulation of each of the feature-binding first-order oscillators that represent emerging and decaying neural activities of each of the objects guarantees that the oscillating synchrony of the feature-neurons of the following object is higher than the synchrony of the feature-neurons of the first presented object. Thus we model the fact that the following object dominates the preceding object in conscious perception. We also show the capacity of the model to simulate illusory misbinding of features from different objects. The third qualitative effect, the relative release of the first object from backward masking is achieved by priming the non-specific oscillatory modulation ahead in time. (shrink)

This paper argues that a theory of situated vision, suited for the dual purposes of object recognition and the control of action, will have to provide something more than a system that constructs a conceptual representation from visual stimuli: it will also need to provide a special kind of direct (preconceptual, unmediated) connection between elements of a visual representation and certain elements in the world. Like natural language demonstratives (such as `this' or `that') this direct connection allows (...) entities to be referred to without being categorized or conceptualized. Several reasons are given for why we need such a preconcep- tual mechanism which individuates and keeps track of several individual objects in the world. One is that early vision must pick out and compute the relation among several individual objects while ignoring their properties. Another is that incrementally computing and updating representations of a dynamic scene requires keeping track of token individuals despite changes in their properties or locations. It is then noted that a mechanism meeting these requirements has already been proposed in order to account for a number of disparate empiri- cal phenomena, including subitizing, search-subset selection and multiple object tracking (Pylyshyn et al., Canadian Journal of Experimental Psychology 48(2) (1994) 260). This mechanism, called a visual index or FINST, is brie. (shrink)

Some things look more complex than others. For example, a crenulate and richly organized leaf may seem more complex than a plain stone. What is the nature of this experience—and why do we have it in the first place? Here, we explore how object complexity serves as an efficiently extracted visual signal that the object merits further exploration. We algorithmically generated a library of geometric shapes and determined their complexity by computing the cumulative surprisal of their internal (...) skeletons—essentially quantifying the “amount of information” within each shape—and then used this approach to ask new questions about the perception of complexity. Experiments 1–3 asked what kind of mental process extracts visual complexity: a slow, deliberate, reflective process (as when we decide that an object is expensive or popular) or a fast, effortless, and automatic process (as when we see that an object is big or blue)? We placed simple and complex objects in visual search arrays and discovered that complex objects were easier to find among simple distractors than simple objects are among complex distractors—a classic search asymmetry indicating that complexity is prioritized in visual processing. Next, we explored the function of complexity: Why do we represent object complexity in the first place? Experiments 4–5 asked subjects to study serially presented objects in a self‐paced manner (for a later memory test); subjects dwelled longer on complex objects than simple objects—even when object shape was completely task‐irrelevant—suggesting a connection between visual complexity and exploratory engagement. Finally, Experiment 6 connected these implicit measures of complexity to explicit judgments. Collectively, these findings suggest that visual complexity is extracted efficiently and automatically, and even arouses a kind of “perceptual curiosity” about objects that encourages subsequent attentional engagement. (shrink)