Research in vision science, developmental psychology, and the foundations of cognitive science has led some theorists to posit referential mechanisms similar to indices. This hypothesis has been framed within a Fodorian conception of the early vision module. The article shows that this conception is mistaken, for it cannot handle the ‘interface problem’—roughly, how indexing mechanisms relate to higher cognition and conceptual thought. As a result, I reject the inaccessibility of early vision to higher cognition and make some constructive remarks on (...) the perception–cognition interface. -/- 1 The Case for Visual Indices 1.1 Preliminary assumptions 1.2 Transcendental arguments 1.3 Evidence from vision science 2 Visual Indices, Object Files, and Fodorian Modularity 3 The Interface Problem 3.1 Top-down attention and modularity 3.2 Selective attention and information 4 Revising the Indexing Hypothesis 4.1 Revising the perception–cognition interface 4.2 Revising the modularity of early vision 5 Concluding Remarks. (shrink)

In three experiments, subjects attempted to track multiple items as they moved independently and unpredictably about a display. Performance was not impaired when the items were briefly (but completely) occluded at various times during their motion, suggesting that occlusion is taken into account when computing enduring perceptual objecthood. Unimpaired performance required the presence of accretion and deletion cues along fixed contours at the occluding boundaries. Performance was impaired when items were present on the visual field at the same times (...) and to the same degrees as in the occlusion conditions, but disappeared and reappeared in ways which did not implicate the presence of occluding surfaces (e.g. by imploding and exploding into and out of existence, instead of accreting and deleting along a fixed contour). Unimpaired performance did not require visible occluders (i.e. Michotte’s tunnel effect) or globally consistent occluder positions. We discuss implications of these results for theories of objecthood in visual attention. (shrink)

Background: Facial attractiveness influences our perceptions of others, with beautiful faces reaping societal rewards and anomalous faces encountering penalties. The purpose of this study was to determine associations of visual attention with bias and social dispositions toward people with facial anomalies. -/- Methods: Sixty subjects completed tests evaluating implicit bias, explicit bias, and social dispositions before viewing publicly available images of preoperative and postoperative patients with hemifacial microsomia. Eye-tracking was used to register visual fixations. -/- Results: Participants (...) with higher implicit bias scores fixated significantly less on the cheek and ear region preoperatively (P = 0.004). Participants with higher scores in empathic concern and perspective taking fixated more on the forehead and orbit preoperatively (P = 0.045) and nose and lips (P = 0.027) preoperativel. -/- Conclusions: Participants with higher levels of implicit bias spent less visual attention on anomalous facial anatomy, whereas participants with higher levels of empathic concern and perspective taking spent more visual attention on normal facial anatomy. Levels of bias and social dispositions such as empathy may predict layperson gaze patterns toward those with facial anomalies and provide insights to neural mechanisms underlying the "anomalous is bad" paradigm. (shrink)

Event-related potential studies have attempted to discover the processes that underlie conscious visual perception by contrasting ERPs produced by stimuli that are consciously perceived with those that are not. Variability of the proposed ERP correlates of consciousness is considerable: the earliest proposed ERP correlate of consciousness coincides with sensory processes and the last one marks postperceptual processes. A negative difference wave called visual awareness negativity , typically observed around 200 ms after stimulus onset in occipitotemporal sites, gains strong (...) support for reflecting the processes that correlate with, and possibly enable, aware visual perception. Research suggests that the early parts of conscious processing can proceed independently of top-down attention, although top-down attention may modulate visual processing even before consciousness. Evidence implies that the contents of consciousness are provided by interactions in the ventral stream, but indispensable contributions from dorsal regions influence already low-level visual responses. (shrink)

This paper investigates the stabilization and trajectory tracking problem of wheeled mobile robot with a ceiling-mounted camera in complex environment. First, an adaptive visual servoing controller is proposed based on the uncalibrated kinematic model due to the complex operation environment. Then, an adaptive controller is derived to provide a solution of uncertain dynamic control for a wheeled mobile robot subject to parametric uncertainties. Furthermore, the proposed controllers can be applied to a more general situation where the parallelism requirement (...) between the image plane and operation plane is no more needed. The overparameterization of regressor matrices is avoided by exploring the structure of the camera-robot system, and thus, the computational complexity of the controller can be simplified. The Lyapunov method is employed to testify the stability of a closed-loop system. Finally, simulation results are presented to demonstrate the performance of the suggested control. (shrink)

The notion that visual attention can operate over visual objects in addition to spatial locations has recently received much empirical support, but there has been relatively little empirical consideration of what can count as an `object' in the ®rst place. We have investi- gated this question in the context of the multiple object tracking paradigm, in which subjects must track a number of independently and unpredictably moving identical items in a ®eld of identical distractors. What types of (...) feature clusters can be tracked in this manner? In other words, what counts as an `object' in this task? We investigated this question with a technique we call target merging: we alter tracking displays so that distinct target and distractor loca- tions appear perceptually to be parts of the same object by merging pairs of items (one target with one distractor) in various ways ± for example, by connecting item locations with a simple line segment, by drawing the convex hull of the two items, and so forth. The data show that target merging makes the tracking task far more dif®cult to varying degrees depending on exactly how the items are merged. The effect is perceptually salient, involving in some conditions a total destruction of subjects' capacity to track multiple items. These studies provide strong evidence for the object-based nature of tracking, con®rming that in some contexts attention must be allocated to objects rather than arbitrary collections of features. In addition, the results begin to reveal the types of spatially organized scene components that can be independently attended as a function of properties such as connectedness, part struc- ture, and other types of perceptual grouping. q 2001 Elsevier Science B.V. All rights reserved. (shrink)

The current contents of visual working memory can be disrupted by previously formed memories. This phenomenon is known as proactive interference, and it can be used to index the availability of old memories. However, there is uncertainty about the robustness and lifetime of proactive interference, which raises important questions about the role of temporal factors in forgetting. The present study assessed different factors that were expected to influence the persistence of proactive interference over an inter-trial interval in the (...) class='Hi'>visual recent probes task. In three experiments, participants encoded arrays of targets and then determined whether a single probe matched one of those targets. On some trials, the probe matched an item from the previous trial, whereas on other trials the probe matched a more distant item. Prior studies have found that recent negative probes can increase errors and slow response times in comparison to non-recent negative probes, and this offered a behavioral measure of proactive interference. In Experiment 1, factors of array size and inter-trial interval were manipulated in the recent probes task. There was a reduction in proactive interference when a longer delay separated trials on one measure, but only when participants encoded two targets. When working memory capacity was strained by increasing the array size to four targets, proactive interference became stronger after the long delay. In Experiment 2, the inter-trial interval length was again manipulated, along with stimulus novelty. Proactive interference was modestly stronger when a smaller number of stimuli were used throughout the experiment, but proactive interference was minimally affected by the inter-trial interval. These findings are problematic for temporal models of forgetting, but Experiment 3 showed that proactive interference also resisted disruption produced by a secondary task presented within the inter-trial interval. Proactive interference was constantly present and generally resilient to the different manipulations. The combined data suggest a relatively durable, passive representation that can disrupt current working memory under a variety of different circumstances. (shrink)

Access to communication is critical for individuals with late-stage amyotrophic lateral sclerosis and minimal volitional movement, but they sometimes present with concomitant visual or ocular motility impairments that affect their performance with eye tracking or visual brain-computer interface systems. In this study, we explored the use of modified eye tracking and steady state visual evoked potential BCI, in combination with the Shuffle Speller typing interface, for this population. Two participants with late-stage ALS, visual impairments, (...) and minimal volitional movement completed a single-case experimental research design comparing copy-spelling performance with three different typing systems: commercially available eye tracking communication software, Shuffle Speller with modified eye tracking, and Shuffle Speller with SSVEP BCI. Participant 1 was unable to type any correct characters with the commercial system, but achieved accuracies of up to 50% with Shuffle Speller eye tracking and 89% with Shuffle Speller BCI. Participant 2 also had higher maximum accuracies with Shuffle Speller, typing with up to 63% accuracy with eye tracking and 100% accuracy with BCI. However, participants’ typing accuracy for both Shuffle Speller conditions was highly variable, particularly in the BCI condition. Both the Shuffle Speller interface and SSVEP BCI input show promise for improving typing performance for people with late-stage ALS. Further development of innovative BCI systems for this population is needed. (shrink)

Two visual world experiments investigated the processing of the implicature associated with some using a “gumball paradigm.” On each trial, participants saw an image of a gumball machine with an upper chamber with orange and blue gumballs and an empty lower chamber. Gumballs dropped to the lower chamber, creating a contrast between a partitioned set of gumballs of one color and an unpartitioned set of the other. Participants then evaluated spoken statements, such as “You got some of the blue (...) gumballs.” Experiment 1 investigated the time course of the pragmatic enrichment from some to not all when the only utterance alternatives available to refer to the different sets were some and all. In Experiment 2, the number terms two, three, four, and five were also included in the set of alternatives. Scalar implicatures were delayed relative to the interpretation of literal statements with all only when number terms were available. The results are interpreted as evidence for a constraint-based account of scalar implicature processing. (shrink)

Previous research has shown that language comprehenders resolve reference quickly and incrementally, but not much is known about the neural processes and representations that are involved. Studies of visual short-term memory suggest that access to the representation of an item from a previously seen display is associated with a negative evoked potential at posterior electrodes contralateral to the spatial location of that item in the display. In this paper we demonstrate that resolving the reference of a noun phrase in (...) a recently seen visual display is associated with an event-related potential that is analogous to this effect. Our design was adapted from the visual world paradigm: in each trial, participants saw a display containing three simple objects, followed by a question about the objects, such as Was the pink fish next to a boat?, presented word by word. Questions differed in whether the color adjective allowed the reader to identify the referent of the noun phrase or not (i.e., whether one or more objects of the named color were present). Consistent with our hypothesis, we observed that reference resolution by the adjective was associated with a negative evoked potential at posterior electrodes contralateral to spatial location of the referent, starting approximately 333 ms after the onset of the adjective. The fact that the laterality of the effect depended upon the location of the referent within the display suggests that reference resolution in visual domains involves, at some level, a modality-specific representation. In addition, the effect gives us an estimate of the time course of processing from perception of the written word to the point at which its meaning is brought into correspondence with the referential domain. (shrink)

For a large proportion of our daily lives, spontaneously occurring thoughts tend to disengage our minds from goal-directed thinking. Previous studies showed that EEG features such as the P3 and alpha oscillations can predict mind-wandering to some extent, but only with accuracies of around 60%. A potential candidate for improving prediction accuracy is the Steady-State Visual Evoked Potential, which is used frequently in single-trial contexts such as brain-computer interfaces as a marker of the direction of attention. In this study, (...) we modified the sustained attention to response task that is usually employed to measure spontaneous thought to incorporate the SSVEP elicited by a 12.5-Hz flicker. We then examined whether the SSVEP could track and allow for the prediction of the stickiness and task-relatedness dimensions of spontaneous thought. Our results show that the SSVEP evoked by flickering words was able to distinguish between more and less sticky thinking but not between whether a participant was on- or off-task. This suggests that the SSVEP is able to track spontaneous thinking when it is strongly disengaged from the task but not off-task thought in general. Future research should determine the exact dimensions of spontaneous thought to which the SSVEP is most sensitive. (shrink)

Online data collection with infants raises special opportunities and challenges for developmental research. One of the most prevalent methods in infancy research is eye-tracking, which has been widely applied in laboratory settings to assess cognitive development. Technological advances now allow conducting eye-tracking online with various populations, including infants. However, the accuracy and reliability of online infant eye-tracking remain to be comprehensively evaluated. No research to date has directly compared webcam-based and in-lab eye-tracking data from infants, similarly (...) to data from adults. The present study provides a direct comparison of in-lab and webcam-based eye-tracking data from infants who completed an identical looking time paradigm in two different settings. We assessed 4-6-month-old infants in an eye-tracking task that measured the detection of audio-visual asynchrony. Webcam-based and in-lab eye-tracking data were compared on eye-tracking and video data quality, infants’ viewing behavior, and experimental effects. Results revealed no differences between the in-lab and online setting in the frequency of technical issues and participant attrition rates. Video data quality was comparable between settings in terms of completeness and brightness, despite lower frame rate and resolution online. Eye-tracking data quality was higher in the laboratory than online, except in case of relative sample loss. Gaze data quantity recorded by eye-tracking was significantly lower than by video in both settings. In valid trials, eye-tracking and video data captured infants’ viewing behavior uniformly, irrespective of setting. Despite the common challenges of infant eye-tracking across experimental settings, our results point toward the necessity to further improve the precision of online eye-tracking with infants. Taken together, online eye-tracking is a promising tool to assess infants’ gaze behavior but requires careful data quality control. The demographic composition of both samples differed from the generic population on caregiver education: our samples comprised caregivers with higher-than-average education levels, challenging the notion that online studies will per se reach more diverse populations. (shrink)

We investigated the effects of everyday language exposure on the prediction of orthographic and phonological forms of a highly predictable word during listening comprehension. Native Japanese speakers in Tokyo (Experiment 1) and Berlin (Experiment 2) listened to sentences that contained a predictable word and viewed four objects. The critical object represented the target word (e.g., /sakana/;fish), an orthographic competitor (e.g., /tuno/;horn), a phonological competitor (e.g., /sakura/;cherry blossom), or an unrelated word (e.g., /hon/;book). The three other objects were distractors. The Tokyo (...) group fixated the target and the orthographic competitor over the unrelated objects before the target word was mentioned, suggesting that they pre-activated the orthographic form of the target word. The Berlin group showed a weaker bias toward the target than the Tokyo group, and they showed a tendency to fixate the orthographic competitor only when the orthographic similarity was very high. Thus, prediction effects were weaker in the Berlin group than in the Tokyo group. We found no evidence for the prediction of phonological information. The obtained group differences support probabilistic models of prediction, which regard the built-up language experience as a basis of prediction. (shrink)

A number of studies in the extant literature report findings that suggest asymmetry in the way reflexive and pronoun anaphors are interpreted in the early stages of processing: that pronouns are less sensitive to structural constraints, as formulated by Binding Theory, than reflexives, in the initial antecedent retrieval process. However, in previous visual world paradigm eye-tracking studies, these conclusions were based on sentences that placed the critical anaphors within picture noun phrases or prepositional phrases, which have independently been (...) shown not to neatly conform to the Binding Theory principles. We present results from a visual world paradigm eye-tracking experiment that show that when critical anaphors are placed in the indirect object position immediately following a verb as a recipient argument, pronoun and reflexive processing are equally sensitive to structural constraints. (shrink)

The target and background will change continuously in the long-term tracking process, which brings great challenges to the accurate prediction of targets. The correlation filter algorithm based on manual features is difficult to meet the actual needs due to its limited feature representation ability. Thus, to improve the tracking performance and robustness, an improved hierarchical convolutional features model is proposed into a correlation filter framework for visual object tracking. First, the objective function is designed by lasso (...) regression modeling, and a sparse, time-series low-rank filter is learned to increase the interpretability of the model. Second, the features of the last layer and the second pool layer of the convolutional neural network are extracted to realize the target position prediction from coarse to fine. In addition, using the filters learned from the first frame and the current frame to calculate the response maps, respectively, the target position is obtained by finding the maximum response value in the response map. The filter model is updated only when these two maximum responses meet the threshold condition. The proposed tracker is evaluated by simulation analysis on TC-128/OTB2015 benchmarks including more than 100 video sequences. Extensive experiments demonstrate that the proposed tracker achieves competitive performance against state-of-the-art trackers. The distance precision rate and overlap success rate of the proposed algorithm on OTB2015 are 0.829 and 0.695, respectively. The proposed algorithm effectively solves the long-term object tracking problem in complex scenes. (shrink)

In this study, 44 late elementary students’ visual behavior patterns when reading mind maps were investigated, more particularly, the intuitive processing nature of their visual characteristics, reading sequence and presentation mode. Eye-tracked data were investigated by means of static early attention and dynamic educational process mining analysis and combined with learning performance and retrospective interview data. All students seem to struggle with the map’s radial structure during initial reading. Also, the picture’s position in the map diverts students from (...) consecutively reading interconnected branches. EPM analyses revealed different reading patterns in proceeding reading behavior. Students receiving a text first, seem to grasp the radial structure slightly more and show higher information integration attempts. They also attained higher free recall and coherence scores. The study concludes with instructional design principles for urgently needed explicit visual literacy instruction in elementary grades. (shrink)

Evidence from cognitive science supports the claim that humans and other animals see the world as divided into objects. Although this claim is widely accepted, it remains unclear whether the mechanisms of visual reference have representational content or are directly instantiated in the functional architecture. I put forward a version of the former approach that construes object files as icons for objects. This view is consistent with the evidence that motivates the architectural account, can respond to the key arguments (...) against representational accounts, and has explanatory advantages. I draw general lessons for the philosophy of perception and the naturalization of intentionality. (shrink)

Visual working memory is a construct hypothesized to store a small amount of accurate perceptual information that can be brought to bear on a task. Much research concerns the construct's capacity and the precision of the information stored. Two prominent theories of VWM representation have emerged: slot-based and continuous-resource mechanisms. Prior modeling work suggests that a continuous resource that varies over trials with variable capacity and a potential to make localization errors best accounts for the empirical data. Questions remain (...) regarding the variability in VWM capacity and precision. Using a novel eye-tracking paradigm, we demonstrate that VWM facilitates search and exhibits effects of fixation frequency and recency, particularly for prior targets. Whereas slot-based memory models cannot account for the human data, a novel continuous-resource model does capture the behavioral and eye tracking data, and identifies the relevant resource as item activation. (shrink)

This paper argues that a theory of situated vision, suited for the dual purposes of object recognition and the control of action, will have to provide something more than a system that constructs a conceptual representation from visual stimuli: it will also need to provide a special kind of direct (preconceptual, unmediated) connection between elements of a visual representation and certain elements in the world. Like natural language demonstratives (such as `this' or `that') this direct connection allows entities (...) to be referred to without being categorized or conceptualized. Several reasons are given for why we need such a preconcep- tual mechanism which individuates and keeps track of several individual objects in the world. One is that early vision must pick out and compute the relation among several individual objects while ignoring their properties. Another is that incrementally computing and updating representations of a dynamic scene requires keeping track of token individuals despite changes in their properties or locations. It is then noted that a mechanism meeting these requirements has already been proposed in order to account for a number of disparate empiri- cal phenomena, including subitizing, search-subset selection and multiple object tracking (Pylyshyn et al., Canadian Journal of Experimental Psychology 48(2) (1994) 260). This mechanism, called a visual index or FINST, is brie. (shrink)

This study investigates a new experimental paradigm called the Modified Traveling Salesman Problem. This task requires subjects to visit once and only once n invisible targets in a 2D display, using a virtual vehicle controlled by the subject. Subjects can only see the directions of the targets from the current location of the vehicle, displayed by a set of oriented segments that can be viewed inside a circular window surrounding the vehicle. Two conditions were compared. In the “allocentric” condition, subjects (...) see the vehicle move across the screen and change orientation under their command. The “egocentric” condition is similar except for how the information is provided: the position and orientation of the vehicle icon remains fixed at the center of the screen and only target directions, as indicated by the oriented segments, change as the subject “moves” the vehicle. The unexpected finding was that this task can be performed, in either condition, for up to 10 targets. We consider two possible strategies that might be used, a location-based strategy and a segment strategy. The location-based strategy relies on spatial memory and attempts to infer the locations of all the targets. The segment strategy is more local and focuses on the directional segments themselves, keeping track of the ones that represent already-visited targets. A number of observations suggest that the segment strategy was used, at least for larger numbers of targets. According to our hypothesis, keeping track of the segments requires one to use indexical reference for associating the segments with their status in the task - given by current status predicates Visited or Not-visited -, perhaps using visual indexes, deictic pointers, or object files. (shrink)

Eye-tracking studies have revealed a specific visual exploration style characterizing individuals with Autism Spectrum Disorder (ASD). The aim of this study is to investigate the impact of stimulus type (static vs. dynamic) on visual exploration in children with ASD. Twenty-eight children with ASD, 28 children matched for developmental communication age and 28 children matched for chronological age watched a video and a series of photos involving the same joint attention scene. For each stimulus, Areas of Interest (AOI) (...) were determined based on Voronoi diagrams, which were defined around participants’ fixation densities, defined by the mean shift algorithm. To analyze the eye-tracking data on visual exploration, we used a method for creat-ing AOI a posteriori, based on participants’ actual fixations. The results showed the value of both kinds of stimuli. The photos allowed for the identification of more precise AOI, and show similarities in exploration between ASD and typical children. On the other hand, in video, among ASD children only, there are few differences in the way they look at the target depend-ing on the deictic cue used. This raises questions regarding their understanding of a joint atten-tion bid recorded on a video. Finally, whatever the stimulus, pointing seems to be the most im-portant element for children to look at the target. (shrink)

Evidence from adult studies of deaf signers supports the dissociation between neural systems involved in processing visual linguistic and non-linguistic body actions. The question of how and when this specialization arises is poorly understood. Visual attention to these forms is likely to change with age and be affected by prior language experience. The present study used eye-tracking methodology with infants and children as they freely viewed alternating video sequences of lexical American sign language (ASL) signs and non-linguistic (...) body actions (self-directed grooming action and object-directed pantomime). In Experiment 1, we quantified fixation patterns using an area of interest (AOI) approach and calculated face preference index (FPI) values to assess the developmental differences between 6 and 11-month-old hearing infants. Both groups were from monolingual English-speaking homes with no prior exposure to sign language. Six-month-olds attended the signer’s face for grooming; but for mimes and signs, they were drawn to attend to the “articulatory space” where the hands and arms primarily fall. Eleven-month-olds, on the other hand, showed a similar attention to the face for all body action types. We interpret this to reflect an early visual language sensitivity that diminishes with age, just before the child’s first birthday. In Experiment 2, we contrasted 18 hearing monolingual English-speaking children (mean age of 4.8 years) vs. 13 hearing children of deaf adults (CODAs; mean age of 5.7 years) whose primary language at home was ASL. Native signing children had a significantly greater face attentional bias than non-signing children for ASL signs, but not for grooming and mimes. The differences in the visual attention patterns that are contingent on age (in infants) and language experience (in children) may be related to both linguistic specialization over time and the emerging awareness of communicative gestural acts. (shrink)

Speakers’ perception of a visual scene influences the language they use to describe it—which objects they choose to mention and how they characterize the relationships between them. We show that visual complexity can either delay or facilitate description generation, depending on how much disambiguating information is required and how useful the scene's complexity can be in providing, for example, helpful landmarks. To do so, we measure speech onset times, eye gaze, and utterance content in a reference production experiment (...) in which the target object is either unique or non-unique in a visual scene of varying size and complexity. Speakers delay speech onset if the target object is non-unique and requires disambiguation, and we argue that this reflects the cost of deciding on a high-level strategy for describing it. The eye-tracking data demonstrate that these delays increase when speakers are able to conduct an extensive early visual search, implying that when speakers scan too little of the scene early on, they may decide to begin speaking before becoming aware that their description is underspecified. Speakers’ content choices reflect the visual makeup of the scene—the number of distractors present and the availability of useful landmarks. Our results highlight the complex role of visual perception in reference production, showing that speakers can make good use of complexity in ways that reflect their visual processing of the scene. (shrink)