The “binding problem” has been a central question in vision science for some 30 years: When encoding multiple objects or maintaining them in working memory, how are we able to represent the correspondence between a specific feature and its corresponding object correctly? In this letter we argue that the boundaries of this research program in fact extend far beyond vision, and we call for coordinated pursuit across the broader cognitive science community of this central question for cognition, which we (...) dub “Binding Problem 2.0”. (shrink)

Pessoa et al. (1998a) summarize a wide body of data suggesting that perceptual filling-in phenomena can be attributed to neural filling-in processes. However, they reject, on philosophical grounds, the hypothesis that filled-in representations in the brain are the immediate substrate of visual percepts. It is proposed in this commentary that resonant binding between distributed cortical areas may instead be the crucial ingredient for conscious visual percepts, and that filling-in processes may facilitate the interactions between behaving organisms and object (...) surfaces. These suggestions circumvent some of the philosophical problems associated with the idea of localized visual representations. (shrink)

Color-motion asynchrony (CMA) refers to an apparent lag of direction of motion when a dynamic stimulus changes both color and direction at the same time. The subjective order of simultaneous events, however, is not only perceptual but also subject to illusions during voluntary actions. Self-initiated actions, for example, seem to precede their sensory outcomes following an adaptation to a delay between the action and the sensory feedback. Here, we demonstrate that the extent of the apparent asynchrony can be substantially (...) reduced when direction change is induced by a voluntary key press following a delay adaptation regime. We also show that the reduced color-motion asynchrony effect size following a motor-sensory recalibration is not a result of a change in the onset of perceived direction change relative to that of the color. This is particularly important as it implies, for the first time in the literature, that voluntary action is not only important in forming action-sensory outcome associations but may also act as a binding factor between the two perceptual features of a sensory event. (shrink)

The capacity for feature binding is typically explained in terms of the attribution model: a perceptual state selects an individual and attributes properties to it (Kahneman & Treisman 1984; Clark 2004; Burge 2010). Thus features are bound together in virtue of being attributed to the same individual. While the attribution model successfully explains some cases of binding in perception, not all binding need be understood as property attribution. This chapter argues that some forms of binding—those (...) involving holistic iconic representations, which bind features outside the limits of attention and object files—don’t fit the attribution model. The chapter then sketches an alternative coordination model of binding that construes icons as complex analog representations. (shrink)

(von der Malsburg, 1981), “the binding problem” has with the visual percept of it, so that both are effortlessly captured the attention of researchers across many disci- perceived as being aspects of a single event. I like to plines, including psychology, neuroscience, computa- refer to these sorts of problems as perceptual binding tional modeling, and even philosophy. Despite the is- problems, since they involve unifying aspects of per- sue’s prominence in these fields, what “binding” means cepts. (...) In addition, there are cognitive binding problems: is rarely made explicit. In this paper, I will briefly survey they include relating a concept to a percept, such as the many notions of binding and will introduce some linking the visual representation of an apple to all the issues that will be explored more fully in the reviews semantic knowledge stored about it (it is edible, how it that follow. (shrink)

Prior to the twentieth century, theories of knowledge were inherently perceptual. Since then, developments in logic, statis- tics, and programming languages have inspired amodal theories that rest on principles fundamentally different from those underlying perception. In addition, perceptual approaches have become widely viewed as untenable because they are assumed to implement record- ing systems, not conceptual systems. A perceptual theory of knowledge is developed here in the context of current cognitive science and neuroscience. During perceptual experience, (...) association areas in the brain capture bottom-up patterns of activation in sensory-motor areas. Later, in a top-down manner, association areas partially reactivate sensory-motor areas to implement perceptual symbols. The stor- age and reactivation of perceptual symbols operates at the level of perceptual components – not at the level of holistic perceptual expe- riences. Through the use of selective attention, schematic representations of perceptual components are extracted from experience and stored in memory (e.g., individual memories of green, purr, hot). As memories of the same component become organized around a com- mon frame, they implement a simulator that produces limitless simulations of the component (e.g., simulations of purr). Not only do such simulators develop for aspects of sensory experience, they also develop for aspects of proprioception (e.g., lift, run) and introspec- tion (e.g., compare, memory, happy, hungry). Once established, these simulators implement a basic conceptual system that represents types, supports categorization, and produces categorical inferences. These simulators further support productivity, propositions, and ab- stract concepts, thereby implementing a fully functional conceptual system. Productivity results from integrating simulators combinato- rially and recursively to produce complex simulations. Propositions result from binding simulators to perceived individuals to represent type-token relations. Abstract concepts are grounded in complex simulations of combined physical and introspective events. Thus, a per- ceptual theory of knowledge can implement a fully functional conceptual system while avoiding problems associated with amodal sym- bol systems. Implications for cognition, neuroscience, evolution, development, and artificial intelligence are explored. (shrink)

Theories of binding have recently come into the focus of the consciousness debate. In this review, we discuss the potential relevance of temporal binding mechanisms for sensory awareness. Specifically, we suggest that neural synchrony with a precision in the millisecond range may be crucial for conscious processing, and may be involved in arousal, perceptual integration, attentional selection and working memory. Recent evidence from both animal and human studies demonstrates that specific changes in neuronal synchrony occur during all (...) of these processes and that they are distinguished by the emergence of fast oscillations with frequencies in the gamma-range. (shrink)

Temporal binding occurs when people observe two events that they believe to be causally connected: They underestimate the length of the interval between those two events, when compared with their estimates of the length of intervals between events they believe to be causally unrelated. I discuss temporal binding in the context of Dennett and Kinsbourne’s (Behavioral and Brain Sciences, 15(2), 183–201, 1992) influential argument levelled at what they call ‘Cartesian Materialism’. In particular, I argue that Dennett and Kinsbourne’s (...) argument trades on a representational conception of perceptual experience, which blurs the boundary between perception and judgement, and that temporal binding can serve as a case study for developing an alternative, relational, conception of perceptual experience and of its relation to judgement. Based on research on the mechanisms underlying temporal binding, I provide an explanation of the phenomenon in which perception and judgement play clearly distinct roles. (shrink)

It is tempting to hold that perceptual experience amounts to a co-conscious collection of visual, auditory, tactual, gustatory, and olfactory episodes. If so, each aspect of perceptual experience on each occasion is associated with a specific modality. This paper, however, concerns a core variety of multimodal perceptual experience. It argues that there is perceptually apparent intermodal feature binding. I present the case for this claim, explain its consequences for theorizing about perceptual experience, and defend it (...) against objections. I maintain that just as one thing may perceptually appear at once to jointly bear several features associated with the same sense modality, one thing also may perceptually appear at once to jointly bear features associated with different sense modalities. For instance, just as something may visually appear at once to be both red and round, or to have a red part and a green part, something may multimodally perceptually appear at once to be both bright and loud, or to have a red part and a rough part. The main lesson, I argue, is that perceiving is not just co-consciously seeing, hearing, feeling, tasting, and smelling at the same time. And perceptual phenomenal character is not on each occasion exhausted by that which is distinctive to or associated with a given modality, along with that which accrues thanks to simple co-consciousness. Not all ways of perceiving are modality specific. I defend this account against three main objections: that singular content theorists avoid my conclusions; that apparent infusion of perceptible features is required for perceptually apparent binding but does not occur intermodally; and that the diversity of objects across modalities makes perceptually apparent intermodal binding rare. (shrink)

Temporal binding is the phenomenon in which events related as cause and effect are perceived by humans to be closer in time than they actually are). Despite the fact that temporal binding experiments with humans have relied on verbal instructions, we argue that they are adaptable to nonhuman animals, and that a finding of temporal binding from such experiments would provide evidence of causal reasoning that cannot be reduced to associative learning. Our argument depends on describing and (...) theoretically motivating an intermediate level of representations between the lower levels of associations of sensory features and higher symbolic representations. This intermediate level of representations makes it possible to challenge arguments given by some comparative psychologists that animals lack higher-level abstract and explicit forms of causal reasoning because their cognitive capacities are limited to learning and reasoning at the basic level of perceptual associations. Our multi-level account connects time perception with causal reasoning and provides a philosophically defensible framework for experimental investigations that have not yet been pursued. We describe the structure of some possible experiments and consider the implications that would follow from a positive finding of temporal binding in nonhuman animals. Such a finding would provide evidence of explicit awareness of causal relationships and would warrant attribution of intermediate representations that are more abstract and sophisticated than the associations allowed by the lower level of the two-level account. (shrink)

How do separate brain processes bind to form unified, conscious percepts? This is the perceptual binding problem, which straddles neuroscience and psychology. In fact, two problems exist here: (1) the easy problem of how neural processes are unified, and (2) the hard problem of how this yields unified perceptual consciousness. Binding theories face familiar troubles with (1) and they do not come to grips with (2). This paper argues that neuroelectrical (electromagnetic-field) approaches may help with both (...) problems. Concerning the easy problem, standard accounts of neural binding by synchrony, attention, and convergence raise serious difficulties. These are avoided by neuroelectrical approaches in which the brain’s field binds distributed processes in myriad neurons. Concerning the hard problem, binding theories do not squarely address how to get from neural unity to unified consciousness. This raises metaphysical difficulties involving reductions, emergence, etc. Neuroelectrical (and Russellian) approaches may help avoid these difficulties too. These approaches may thus deserve further investigation as binding theories. (shrink)

Cognitive functions like perception, memory, language, or consciousness are based on highly parallel and distributed information processing by the brain. One of the major unresolved questions is how information can be integrated and how coherent representational states can be established in the distributed neuronal systems subserving these functions. It has been suggested that this so-called ''binding problem'' may be solved in the temporal domain. The hypothesis is that synchronization of neuronal discharges can serve for the integration of distributed neurons (...) into cell assemblies and that this process may underlie the selection of perceptually and behaviorally relevant information. As we intend to show here, this temporal binding hypothesis has implications for the search of the neural correlate of consciousness. We review experimental results, mainly obtained in the visual system, which support the notion of temporal binding. In particular, we discuss recent experiments on the neural mechanisms of binocular rivalry which suggest that appropriate synchronization among cortical neurons may be one of the necessary conditions for the buildup of perceptual states and awareness of sensory stimuli. (shrink)

Cognitive scientists have long known that the modalities interact during perceptual processing. Cross-modal illusions like the ventriloquism effect show that the course of processing in one modality can alter the course of processing in another. But how do the modalities interact in the specific domain of object perception? This paper distinguishes and analyzes two kinds of multisensory interaction in object perception. First, the modalities may bind features to a single object or event. Second, the modalities may cooperate when differentiating (...) an object or event from its surroundings. I critically evaluate evidence for various forms of multisensory binding. I then consider the case for multisensory differentiation. I argue that existing evidence for multisensory differentiation is inconclusive. I highlight ways that the issue might be empirically resolved. (shrink)

Temporal binding via 40-Hz synchronization of neuronal discharges in sensory cortices has been hypothesized to be a necessary condition for the rapid selection of perceptually relevant information for further processing in working memory. Binocular rivalry experiments have shown that late stage visual processing associated with the recognition of a stimulus object is highly correlated with discharge rates in inferotemporal cortex. The hippocampus is the primary recipient of inferotemporal outputs and is known to be the substrate for the consolidation of (...) working memories to long-term, episodic memories. The prefrontal cortex, on the other hand, is widely thought to mediate working memory processes, per se. This article reviews accumulated evidence for the role of a subcortical matrix in linking frontal and hippocampal systems to select and ''stream'' conscious episodes across time (hundreds of milliseconds to several seconds). ''Streaming'' is hypothesized to be mediated by the selective gating of reentrant flows of information between these cortical systems and the subcortical matrix. The physiological mechanism proposed for this temporally extended form of binding is synchronous oscillations in the slower EEG spectrum (< 8 Hz). (shrink)

This paper considers the use of the ‘Mondrian Stimulus’, invented by Edwin H. Land of the Polaroid Corporation, in various investigations in the visual neuropsychology, the neuroaesthetics, and the social psychology of aesthetic response to works of visual art. What difference does it make—in the set-up of these investigations and in our interpretation of their putative results—that the Mondrian Stimulus might be taken to be a ‘real’ painting by the actual Dutch artist Piet Mondrian? How does the existence of a (...) set of ‘real’ Mondrians—more or less well known to many people, including those investigated in experiments by Land, Zeki, and Noll—affect the ways in which the Mondrian Stimulus is apprehended? The paper argues that the Mondrian Stimulus is ‘bound’ to the history and visual recollection of ‘real Mondrians’ at the same time as the ‘real Mondrians’—in their historical afterlives—are bound to other creations of ‘modern abstract art’. These proposals enable a revised approach to the relations between invariant visual responses on the one hand, and different visual cultures or visuality on the other; because of its own special history of ‘binding’ and ‘unbinding’, the Mondrian Stimulus works as an interface between—a binding of—both ‘bottom-up’ perceptual input and processing and ‘top-down’ direction of attention. (shrink)

Several of the essays in this collection discuss the `binding problem', the problem of explaining in neurophysiological terms how it is that we see the various perceptual qualities of a physical object, such as its shape, colour, location and motion, as features of a single object. The perceived object seems to us a unitary thing, but its sensory properties are diverse and turn out to be processed in different areas of the brain. How then does the brain manage (...) the integration? Readers of the essays in this collection may find themselves suffering from an analogous binding problem about the study of consciousness, though this problem is conceptual rather than perceptual, and here the difficulty is to achieve the integration rather than to understand how an effortless integration is achieved. Consciousness is the ideal topic for inter-disciplinary investigation. It is a central concern of such diverse disciplines as neurophysiology, evolutionary biology, psychology, cognitive science, philosophy and theology, among others, yet none of these disciplines has come close to providing full answers to the central questions that consciousness raises. Inter-disciplinary investigation seems an obvious way forward, but it generates the conceptual binding problem that this collection displays. The standard of the essays is very high, but it is extraordinarily difficult to integrate their content into anything like a single picture. We are all apparently talking about the same phenomenon, the conscious awareness of the world that each of us enjoys first-hand, but it is quite unclear how to see the very different things we say about this phenomenon as part of a single picture, or even as parts of different but compatible pictures. Having raised the binding problem for the inter-disciplinary study of consciousness, I hasten to say that I will not attempt even a partial substantive solution here: that is left as an exercise for the readers of this book. (shrink)

Introduction to the topical collection "The Structure of Perceptual Objects"—with contributions by Mohan Matthen, EJ Green, Alisa Mandrigin, Blazej Skrzypulec, and Anna Drożdżowicz.

Synaesthesia is an excellent model for understanding perceptual binding in the human brain. Current evidence suggests that if synaesthetic colour is bound, it is through the same attention-dependent integration of feature maps that occurs in other forms of binding. synaesthetic colour arises after the point that separate wavelengths blend in normal colour vision, which creates a perceptual paradox where synaesthetic and print colour can appear bound to a single location without blending. If a letter is printed (...) in a colour that is different from the synaesthetic colour it induces, the two hues will activate different hue-selective maps allowing for dual representation of colour, but if synaesthetic and print colours are the same/similar they will co-activate the same hue-selective map and create an amplified colour signal. Studies suggest that the parietal cortex plays a key role in this binding of synaesthetic and/or print colour to shape. (shrink)

To view organismic functioning in terms of integration is a mistake, although the concept has dominated scientific thinking this century. The operative concept for interpreting the organism proposed here is that of ‘articulation’ or decomposition rather than that of composition from segregated parts. It is asserted that holism is the fundamental state of all phenomena, including organisms. The impact of this changed perspective on perceptual theorizing is profound. Rather than viewing it as a process resulting from internal integration of (...) isolated features detected by receptor neurons into a perceptual whole, the new theory suggests that the task of perceptual processing is to break up what initially exists holistically in sense organs into features and eventually perceived objects. Similarly, the goal of perceptual activity is not Sherrington's, that of integrating essentially unrelated organisms with their environmental surround, but rather to generate percepts in which the environment appears as a field of objects and events independent of the perceiver which are available for manipulation. Perception is a process by which organisms use their embeddedness in physical reality as if they were independent of it. There are a number of interesting results of this conceptual reorientation. The binding problem is eliminated because the percept's holistic character is the precondition for neural activity, not its product. The concept of representation can be dispensed with since the fundamental conceptual motivation for its introduction -- the assumed need to produce an internal copy of what was assumed to exist independently outside the organism in order to integrate organismic behaviour with its environmental causes -- is rejected outright. And finally, the issue of perceptual consciousness is addressed: how does the percept acquire its objective status vis-a-vis a perceiver, and what is the basis of the experiential character of perception? (shrink)

We introduce a new version of the perceptual retouch model. This model was used for explaining properties of temporal interaction of successive objects in reaching conscious representation. The new model incorporates two interactive binding operations – binding features for objects and binding the bound feature-objects with a large scale oscillatory system that corresponds to perceptual consciousness. Here, the typical result of masking experiments – second object advantage in conscious perception – is achieved by applying the (...) effects of a common synchronizing oscillator with a delay. This delayed modulation of each of the feature-binding first-order oscillators that represent emerging and decaying neural activities of each of the objects guarantees that the oscillating synchrony of the feature-neurons of the following object is higher than the synchrony of the feature-neurons of the first presented object. Thus we model the fact that the following object dominates the preceding object in conscious perception. We also show the capacity of the model to simulate illusory misbinding of features from different objects. The third qualitative effect, the relative release of the first object from backward masking is achieved by priming the non-specific oscillatory modulation ahead in time. (shrink)

Perception of the external world is an essential part of the animal (including human) life, both as a source of knowledge and as a way to survive. Medieval authors accepted this view, and despite general concerns about the reliability of the senses in the acquisition of certain and objective knowledge, they thought that for the most part our perceptual system gets things right when it comes to the perceptual features of things—but not always. Our article focuses on thirteenth- (...) and fourteenth-century philosophical discussions of illusions and other types of perceptual errors. Reception of incorrect information, misjudgments concerning perceptual objects, the binding problem, and similar cases that explain perceptual errors will be analyzed. We discuss what might be called medieval Aristotelian/Avicennian theories of perception and the internal senses (drawing mainly from Albertus Magnus and Thomas Aquinas), as well as the so-called perspectivist accounts of perception, especially that by Alhacen. Finally, we take up a debate between Peter Auriol and his critics, which contains elements that can be seen as precursors of later skeptical worries. The concern here is that, just like in contemporary discussions leading to disjunctivism, the absence of a secure way to distinguish between veridical and non-veridical perception leads to a general worry about the reliability of our experience of the world. (shrink)

The binding problem is to explain how information processed by different sensory systems is brought together to unify perception. The problem has two sides. First, we want to explain phenomenal binding: the fact that we experience a single world rather than separate perceptual fields for each sensory modality. Second, we must solve a functional problem: to explain how a neural net like the brain links instances to types. I argue that phenomenal binding and functional binding (...) require very different treatments. The puzzle of phenomenal binding rests on a confusion and so can be dissolved. So only functional binding deserves explanation. The general solution to that problem is that information to be bound is arrayed along different dimensions. So sensory coding into separate topographic maps facilitates functional binding and there is no need based on the unity of perception for special mechanisms that bring "back together" information in different maps. (shrink)

The first part of this survey article presented a cartography of some of the more extensively studied forms of multisensory processing. In this second part, I turn to examining some of the different possible ways in which the structure of conscious perceptual experience might also be characterized as multisensory. In addition, I discuss the significance of research on multisensory processing and multisensory consciousness for philosophical debates concerning the modularity of perception, cognitive penetration, and the individuation of the senses.

Given what we know about the segregated nature of the brain and the relative absence of multi-modal association areas in the cortex, how percepts become unified is not clear. However, if we could work out how and where the brain joins together segregated outputs, we would have a start in localizing the neuronal processes that correlate with conscious perceptual experiences. In this essay, I critically examine data relevant for understanding the neurophysiological underpinnings of perception. In particular, I examine the (...) possibility that 40 Hz. oscillatory firing patterns in cortex are important lower-level neuronal events related to perceptual experiences. I suggest that `binding' - understood as a process of hooking together disparate psychological units - reduces to a property inherent in the structure of our brain's firing patterns. However, this reduction may not reflect the firing rates of individual cells, but instead a `higher level' order superimposed on individual cells' activity. (shrink)

Neurophysiological studies in humans employing magneto- and electro- encephalography increasingly suggest that oscillatory rhythmic activity of the brain may be a core mechanism for binding sensory information across space, time, and object features to generate a unified perceptual representation. To distinguish whether oscillatory activity is causally related to binding processes or whether, on the contrary, it is a mere epiphenomenon, one possibility is to employ neuromodulatory techniques such as transcranial alternating current stimulation. tACS has seen a rising (...) interest due to its ability to modulate brain oscillations in a frequency-dependent manner. In the present review, we critically summarize current tACS evidence for a causal role of oscillatory activity in spatial, temporal, and feature binding in the context of visual perception. For temporal binding, the emerging picture supports a causal link with the power and the frequency of occipital alpha rhythms ; however, there is no consistent evidence on the causal role of the phase of occipital tACS. For feature binding, the only study available showed a modulation by occipital alpha tACS. The majority of studies that successfully modulated oscillatory activity and behavioral performance in spatial binding targeted parietal areas, with the main rhythms causally linked being the theta and beta frequency bands. On the other hand, spatio-temporal binding has been directly modulated by parieto-occipital gamma and alpha tACS, suggesting a potential role of cross-frequency coupling when binding across space and time. Nonetheless, negative or partial results have also been observed, suggesting methodological limitations that should be addressed in future research. Overall, the emerging picture seems to support a causal role of brain oscillations in binding processes and, consequently, a certain degree of plasticity for shaping binding mechanisms in visual perception, which, if proved to have long lasting effects, can find applications in different clinical populations. (shrink)

Computational neuroscience attributes coloured areas and other perceptual qualia to calculations that are realizable in multiple cellular forms. This faces serious issues in explaining how the various qualia arise and how they bind to form overall perceptions. Qualia may instead be neuroelectrical. Growing evidence indicates that perceptions correlate with neuroelectrical activity spotted by locally activated EEGs, the different qualia correlate with the different electrochemistries of unique detector cells, a unified neural-electromagnetic field binds this activity to form overall perceptions, and (...) this field interacts with sensory circuits to help attentively guide perception. The coloured areas in images may thus be seated in the electrochemistry of unique cells, while constancy mechanisms and other multiply realizable computations just help refine these images behind the scenes. This theory is ultimately testable. (shrink)

Glyn Humphreys' research on attention and binding began from feature‐integration theory, which claims that binding together visual features, such as colour and orientation, requires spatially selective attention. Humphreys employed a more inclusive notion of binding and argued, on neuropsychological grounds, for a multi‐stage account of the overall binding process, in which binding together of form elements was followed by two stages of feature binding. Only the second stage of feature binding, a re‐entrant (top‐down) (...) process beginning in posterior parietal cortex and returning to early visual areas, required attention. In line with his commitment to converging evidence, Humphreys considered that investigating the role of attention in motion‐induced blindness could be a route to better understanding of the cognitive role of the attention‐dependent second stage of feature binding. He suggested that this role might be to resolve ambiguity and to generate a single consistent interpretation of the perceptual input. (shrink)

Our daily lives unfold continuously, yet our memories are organised into distinct events, situated in a specific context of space and time, and chunked when this context changes (at event boundaries). Previous research showed that this process, termed event segmentation, enhances object-context binding but impairs temporal order memory. Physiologically, peaks in pupil dilation index event segmentation, similar to emotion-induced bursts of autonomic arousal. Emotional arousal also modulates object-context binding and temporal order memory. Yet, these two critical factors have (...) not been systematically studied together. To address this gap, we ran a behavioural experiment using a paradigm validated to study event segmentation and extended it with emotion manipulation. During encoding, we sequentially presented greyscale objects embedded in coloured frames (colour changes defining events), with a neutral or aversive sound. During retrieval, we tested participants’ memory of temporal order memory and object-colour binding. We found opposite effects of emotion and event segmentation on episodic memory. While event segmentation enhanced object-context binding, emotion impaired it. On the contrary, event segmentation impaired temporal order memory, but emotion enhanced it. These findings increase our understanding of episodic memory organisation in laboratory settings, and potentially in real life with perceptual changes and emotion fluctuations constantly interacting. (shrink)

All non-relational views of perceptual experience face Jackson's famous many-property problem. I argue that the original problem, and the existing responses to it, have focused too closely on the controversial terminology for which adverbialism is best known. We can also direct Jackson's many-property problem explicitly onto the adverbialist's metaphysics, generating a new challenge. The responses contemporary adverbialists and non-relationalists have made to the original objection are not successful against this challenge. We need a new non-relational account. I sketch an (...) outline of a new theory, and motivate the view by explaining how it can respond successfully to this additional challenge. -/- . (shrink)

We present a neural dynamic model that perceptually grounds nested noun phrases, that is, noun phrases that contain further (possibly also nested) noun phrases as parts. The model receives input from the visual array and a representation of a noun phrase from language processing. It organizes a search for the denoted object in the visual scene. The model is a neural dynamic architecture of interacting neural populations which has clear interfaces with perceptual processes. It solves a set of theoretical (...) challenges, including the problem of keeping a nested structure in short-term memory in a way that solves the problem of 2 and massive binding problem emphasized by Jackendoff. The model organizes a search for the objects that are referenced in that structure. We motivate the model, demonstrate simulation results, and discuss how it differs from related models. (shrink)

We present a neural dynamic model that perceptually grounds nested noun phrases, that is, noun phrases that contain further (possibly also nested) noun phrases as parts. The model receives input from the visual array and a representation of a noun phrase from language processing. It organizes a search for the denoted object in the visual scene. The model is a neural dynamic architecture of interacting neural populations which has clear interfaces with perceptual processes. It solves a set of theoretical (...) challenges, including the problem of keeping a nested structure in short-term memory in a way that solves the problem of 2 and massive binding problem emphasized by Jackendoff. The model organizes a search for the objects that are referenced in that structure. We motivate the model, demonstrate simulation results, and discuss how it differs from related models. (shrink)

Our perception of external features comprises, among others, functional and phenomenological levels. At the functional level, the perceiver’s mind processes external features according to its own causal- functional organization. At the phenomenological level, the perceiver has consciousness of external features. The question of this paper is: How do the functional and the phenomenological levels of perception relate to each other? The answer I propose is that functional states of specifically perceptual attention constitute the necessary basis for the arising of (...) consciousness in a perceiver. -/- Widely studied within cognitive psychology, perceptual attention is still awaiting a thoroughgoing philosophical treatment. The paper presents and draws upon Anne Treisman’s feature-integration theory of attention (cf. A. Treisman & G. Gelade, “A Feature-Integration Theory of Attention,” Cognitive Psychology, 12, 1980. Pp. 97-136). According to this theory, attentional mechanisms are responsible for the binding of perceptual features into coherent and stable objects of perception. By itself, I will claim, the theory of feature integration does not allow a straightforward reduction of consciousness to the functional processing underlying it. However, on the basis of Treisman’s theory we can produce a methodological argument for endorsing the non-reductivist thesis that attentional states constitute the necessary basis for the arising of consciousness in a perceiver. The paper closes by presenting this argument, according to which the thesis is implied by a unified account of the common representational natures of attentional and conscious states. (shrink)

This article proposes an object properties approach to object perception. By thinking about objects as clusters of co-instantiated features that possess certain canonical higher-order object properties we can steer a middle way between two extreme views that are dominant in different areas of empirical research into object perception and the development of the object concept. Object perception should be understood in terms of perceptual sensitivity to those object properties, where that perceptual sensitivity can be explained in a manner (...) consistent with the graded representation approach adopted by some connectionist modellers. The object properties approach does justice to the differences between a perceptual system solving the binding problem, on the one hand, and genuinely perceiving objects, on the other, without running into the theoretical problems associated with treating young infants as 'little scientists'. (shrink)

On the one hand, we think that our conscious perceptions are tied to some stage of whatever processing stream we have. On the other hand, we think that our conscious experiences have to resemble the computational states that instantiate them. However, nothing in our alleged stream resembles our experienced perceptions. Hence, a conflict. The question is: How can we go from what we know about neurons, their connections, and firing patterns, to explaining what conscious perceptual experiences are like? No (...) intuitive answer seems plausible. Our perceptual experiences are complex and unified; however, brains divide their processing tasks into small chunks and segregate those smaller pieces across the gray matter. In this essay, I conjecture that what corresponds to our visual perceptions are higher order patterns of bifurcation in an attractor phase space. If I am correct, then the problem of the explanatory gap in philosophy, the binding problem in psychology, and the problem of perception in neuroscience disappear. If the traditional computational perspective is wrong, and sensory processing is not piece-meal, step-wise, and segregated, then there is no need for something in the head to tie things together. (shrink)

Perruchet & Vinter claim that with the additional capacity to determine whether two arbitrary stimuli are the same or different, their association-based PARSER model is sufficient to account for learning transfer. This claim overstates the generalization capacity of perceptual versus nonperceptual (symbolic) relational processes. An example shows why some types of learning transfer also require the capacity to bind arbitrary representations to nonperceptual relational symbols.

The fundamental relations that underlie cognitive comparisons—“same” and “different”—can be defined at multiple levels of abstraction, which vary in relational complexity. We compared response times to decide whether or not two sequentially‐presented patterns, each composed of two pairs of colored squares, were the same at three levels of abstraction: perceptual, relational, and system (higher order relations). For both 150 ms and 5 s inter‐stimulus intervals (ISIs), both with and without a masking stimulus, decision time increased with level of abstraction. (...) Sameness at lower complexity levels contributed to decisions based on the higher levels. The pattern of comparison times across levelswas not predictable solely from encoding times. The results indicated that relations at multiple levels of complexity can be abstracted and compared in working memory, with higher complexity levels requiring more processing time. We simulated the impact of relational complexity on response time using Learning and Inference with Schemas and Analogies (LISA), a computational model of relational comparisons based on dynamic binding of elements into roles in a relational working memory. (shrink)

& How does neuronal activity bring about the interpretation of visual space in terms of objects or complex perceptual events? If they group, simple visual features can bring about the integration of spikes from neurons responding to different features to within a few milliseconds. Considered as a potential solution to the ‘‘binding problem,’’ it is suggested that neuronal synchronization is the glue for binding together different features of the same object. This idea receives some support from correlated- (...) and periodic-stimulus motion paradigms, both of which suggest that the segregation of a figure from ground is a direct result of the temporal correlation of visual signals. One could say that perception of a highly correlated visual.. (shrink)

The fundamental relations that underlie cognitive comparisons—“same” and “different”—can be defined at multiple levels of abstraction, which vary in relational complexity. We compared response times to decide whether or not two sequentially‐presented patterns, each composed of two pairs of colored squares, were the same at three levels of abstraction: perceptual, relational, and system (higher order relations). For both 150 ms and 5 s inter‐stimulus intervals (ISIs), both with and without a masking stimulus, decision time increased with level of abstraction. (...) Sameness at lower complexity levels contributed to decisions based on the higher levels. The pattern of comparison times across levelswas not predictable solely from encoding times. The results indicated that relations at multiple levels of complexity can be abstracted and compared in working memory, with higher complexity levels requiring more processing time. We simulated the impact of relational complexity on response time using Learning and Inference with Schemas and Analogies (LISA), a computational model of relational comparisons based on dynamic binding of elements into roles in a relational working memory. (shrink)

Previous research has successfully used feature integration theory to operationalise the predictions of Perceptual Load Theory, while simultaneously testing the predictions of both models. Building on this work, we test the extent to which these models hold up in a 3D world. In two experiments, participants responded to a target stimulus within an array of shapes whose apparent depth was manipulated using a combination of monoscopic and stereoscopic cues. The search task was designed to test the predictions of feature (...) integration theory, as the target was identified by a single feature or a conjunction of features and embedded in search arrays of varying size, and perceptual load theory, as the task included congruent and incongruent distractors presented alongside search tasks imposing high or low perceptual load. Findings from both experiments upheld the predictions of feature integration theory, regardless of 2D/3D condition. Longer search times in conditions with a combination of monoscopic and stereoscopic depth cues suggests that binding features into three-dimensional objects requires greater attentional effort. This additional effort should have implications for perceptual load theory, yet our findings did not uphold its predictions; the effect of incongruent distractors did not differ between conjunction search trials and feature search trials. Individual differences in susceptibility to the effects of perceptual load were evident and likely explain the absence of load effects. Overall, our findings suggest that feature integration theory may be useful for predicting attentional performance in a 3D world. (shrink)

A central issue of cognitive neuroscience is to understand how a large collection of coupled neurons combines external signals with internal memories into new coherent patterns of meaning. An external stimulus localized at some input spreads over a large assembly of coupled neurons, building up a collective state univocally corresponding to the stimulus. Thus, the synchronization of spike trains of many individual neurons is the basis of a coherent perception. Based on recent investigations of homoclinic chaotic systems and their synchronization, (...) a novel conjecture for the dynamics of single neurons and, consequently, for neuron assemblies is formulated. Homoclinic chaos is proposed as a suitable way to code information in time by trains of equal spikes occurring at apparently erratic times. In order to classify the set of different perceptions, the percept space can be given a metric structure by introducing a distance measure between distinct percepts. The distance in percept space is conjugate to the duration of the perception in the sense that an uncertainty relation in percept space is associated with time-limited perceptions. This coding of different percepts by synchronized spike trains entails fundamental quantum features which are not restricted to microscopic phenomena. It is conjectured that they are related to the details of the perceptual chain rather than depending on Planck's action. (shrink)

A central issue of cognitive neuroscience is to understand how a large collection of coupled neurons combines external signals with internal memories into new coherent patterns of meaning. An external stimulus localized at some input spreads over a large assembly of coupled neurons, building up a collective state univocally corresponding to the stimulus. Thus, the synchronization of spike trains of many individual neurons is the basis of a coherent perception. Based on recent investigations of homoclinic chaotic systems and their synchronization, (...) a novel conjecture for the dynamics of single neurons and, consequently, for neuron assemblies is formulated. Homoclinic chaos is proposed as a suitable way to code information in time by trains of equal spikes occurring at apparently erratic times. In order to classify the set of different perceptions, the percept space can be given a metric structure by introducing a distance measure between distinct percepts. The distance in percept space is conjugate to the duration of the perception in the sense that an uncertainty relation in percept space is associated with time-limited perceptions. This coding of different percepts by synchronized spike trains entails fundamental quantum features which are not restricted to microscopic phenomena. It is conjectured that they are related to the details of the perceptual chain rather than depending on Planck's action. (shrink)