The purpose of this study is to take preliminary steps to unify psychoacoustic techniques with reaction-time methodologies to address the perceptual mechanisms responsible for the detection of one vs. multiple sounds. We measured auditory redundancy gains for auditory detection of pure tones widely spaced in frequency using the tools of Systems Factorial Technology to evince the system architecture and workload capacity in two different scenarios. We adopted an experimental design in which the presence or absence of a target (...) at each of two frequencies was combined factorially with two stimulus levels. Replicating previous work, results did not allow an assessment of system architecture due to a failure to observe factor influence at the level of distribution ordering for dual-target stimuli for both SOFT and LOUD scenarios. All subjects demonstrated very modest redundancy gains for the dual-target compared to the single-target stimuli, and results were similar for both LOUD and SOFT. We propose that these results can be predicted by a mental architecture that falls into the class of integrated subadditive parallel systems, using a well-supported assumption that reaction time is driven by loudness. We demonstrate that modeled loudness of the experimental sounds is highly correlated with mean reaction time, and we provide a proof-of-concept model based on Steven’s Power law that predicts both a failure of distributional ordering for dual-target stimuli and very modest redundancy gains. (shrink)

This investigation examined age-related differences in auditory-visual integration as reflected on perceptual judgments of temporally misaligned AV English sentences spoken by native English and native Spanish talkers. In the detection task, it was expected that slowed auditory temporal processing of older participants, relative to younger participants, would be manifest as a shift in the range over which participants would judge asynchronous stimuli as synchronous. The older participants were also expected to exhibit greater declines in speech recognition for (...) asynchronous AV stimuli than younger participants. Talker accent was hypothesized to influence listener performance, with older listeners exhibiting a greater narrowing of the AV simultaneity window and much poorer recognition of asynchronous AV foreign-accented speech compared to younger listeners. Participant groups included younger and older participants with normal hearing and older participants with hearing loss. Stimuli were video recordings of sentences produced by native English and native Spanish talkers. The video recordings were altered in 50 ms steps by delaying either the audio or video onset. Participants performed a detection task in which they judged whether the sentences were synchronous or asynchronous, and performed a recognition task for multiple synchronous and asynchronous conditions. Both the detection and recognition tasks were conducted at the individualized signal-to-noise ratio corresponding to approximately 70% correct speech recognition performance for synchronous AV sentences. Older listeners with and without hearing loss generally showed wider AV simultaneity windows than younger listeners, possibly reflecting slowed auditory temporal processing in auditory lead conditions and reduced sensitivity to asynchrony in auditory lag conditions. However, older and younger listeners were affected similarly by misalignment of auditory and visual signal onsets on the speech recognition task. This suggests that older listeners are negatively impacted by temporal misalignments for speech recognition, even when they do not notice that the stimuli are asynchronous. Overall, the findings show that when listener performance is equated for simultaneous AV speech signals, age effects are apparent in detection judgments but not in recognition of asynchronous speech. (shrink)

Change blindness experiments had demonstrated that detection of significant changes in natural images is extremely difficult when brief blank fields are placed between alternating displays of an original and a modified scene. On the other hand, research on the visual mismatch negativity component of the event-related potentials identified sensitivity to events different from the regularity of stimulus sequences, even if the deviant and standard events are non-attended. The present study sought to investigate the apparent controversy between the experience (...) under the change blindness paradigm and the ERP results. To this end, the stimulus of Rensink, O’Reagen, and Clark was adapted to a passive oddball ERP paradigm to investigate the underlying processing differences between the standard and deviant stimuli measured in 22 subjects. Posterior negativity within the 280–330 ms latency range emerged as the difference between ERPs elicited by standard and deviant stimuli, identified as visual mismatch negativity. These results raise the possibility that change blindness is not based on the lack of detailed visual representations or the deficiency of comparing two representations. However, effective discrimination of the two scene versions requires considerable frequency differences between them. (shrink)

Eye-tracking studies have revealed a specific visual exploration style characterizing individuals with Autism Spectrum Disorder (ASD). The aim of this study is to investigate the impact of stimulus type (static vs. dynamic) on visual exploration in children with ASD. Twenty-eight children with ASD, 28 children matched for developmental communication age and 28 children matched for chronological age watched a video and a series of photos involving the same joint attention scene. For each stimulus, Areas of Interest (AOI) were (...) determined based on Voronoi diagrams, which were defined around participants’ fixation densities, defined by the mean shift algorithm. To analyze the eye-tracking data on visual exploration, we used a method for creat-ing AOI a posteriori, based on participants’ actual fixations. The results showed the value of both kinds of stimuli. The photos allowed for the identification of more precise AOI, and show similarities in exploration between ASD and typical children. On the other hand, in video, among ASD children only, there are few differences in the way they look at the target depend-ing on the deictic cue used. This raises questions regarding their understanding of a joint atten-tion bid recorded on a video. Finally, whatever the stimulus, pointing seems to be the most im-portant element for children to look at the target. (shrink)

Detecting that two images are different is faster for highly dissimilar images than for highly similar images. Paradoxically, we showed that the reverse occurs when people are asked to describe how two images differ—that is, to state a difference between two images. Following structure-mapping theory, we propose that this disassociation arises from the multistage nature of the comparison process. Detecting that two images are different can be done in the initial (local-matching) stage, but only for pairs with low (...) overlap; thus, “different” responses are faster for low-similarity than for high-similarity pairs. In contrast, identifying a specific difference generally requires a full structural alignment of the two images, and this alignment process is faster for high-similarity pairs. We described four experiments that demonstrate this dissociation and show that the results can be simulated using the Structure-Mapping Engine. These results pose a significant challenge for nonstructural accounts of similarity comparison and suggest that structural alignment processes play a significant role in visual comparison. (shrink)

Can conscious awareness be ascertained from physiological responses alone? We evaluate a novel learning-based procedure permitting detection of conscious awareness without reliance on language comprehension or behavioural responses. The method exploits a situation whereby only consciously detected violations of an expectation alter skin conductance responses . Thirty participants listened to sequences of piano notes that, without their being told, predicted a pleasant fanfare or an aversive noise according to an abstract rule. Stimuli were presented without distraction , or (...) while distracted by a visual task to remove awareness of the rule . A test phase included occasional violations of the rule. Only participants attending the sounds reported awareness of violations and only they showed significantly greater SCR for noise occurring in violation, vs. accordance, with the rule. Our results establish theoretically significant dissociations between conscious and unconscious processing and furnish new opportunities for clinical assessment of residual consciousness in patient populations. (shrink)

Change blindness—our inability to detect changes in a stimulus—occurs even when the change takes place gradually, without any disruption [Simons, D. J., Franconeri, S. L., & Reimer, R. L. . Change blindness in the absence of a visual disruption. Perception, 29, 1143–1154]. Such gradual changes are more difficult to detect than changes that involve a disruption. Using this method, David et al. [David, E., Laloyaux, C., Devue, C., & Cleeremans, A. . Change blindness to gradual changes in facial expressions. (...) Psychologica Belgica] recently showed substantial blindness to changes that involve facial expressions of emotion. In this experiment, we show that people who failed to detect any change in the displays were nevertheless influenced by the changing information in subsequent recognition decisions about which facial expression they had seen, and that their confidence in their decisions was lower after exposure to changing vs. static displays. The findings therefore support the notion that undetected changes that occur in highly salient stimuli may be causally efficacious and influence subsequent behavior. Implications concerning the nature of the representations associated with undetected changes are discussed. (shrink)

Research over the past half century has produced extensive evidence that observers cannot report or retain all of the details of their visual world from one moment to the next. During the past decade, a new set of studies has illustrated just how pervasive these limits are. For example, early evidence for the failure to detect changes to simple dot patterns (Phillips, 1974) and arrays of letters (Pashler, 1988) generalizes to more naturalistic displays such as photographs and motion pictures (...) (e.g., Levin & Simons, 1997; Rensink, O’Regan, & Clark, 1997; see Rensink, 2002 for a recent review). This failure to report changes (change blindness) can be induced in both simple and naturalistic displays, whenever the change co-occurs with a visual disruption such as an eye movement (Currie, McConkie, Carlson-Radvansky, & Irwin, 1995; Hollingworth, Schrock, & Henderson, 2001), image shift (Blackmore, Brelstaff, Nelson, & Troscianko, 1995), flashed blank screen (Rensink et al., 1997), blink (O’Regan, Deubel, Clark, & Rensink, 2000), transient (O’Regan, Rensink, & Clark, 1999; Rensink, O’Regan, & Clark, 2000), movie cut or pan (Levin & Simons, 1997; Simons, 1996), or an occlusion event (Levin, Simons, Angelone, & Chabris, 2002; Simons & Levin, 1998). Change blindness can also occur in the absence of a disruption, provided the change occurs gradually enough that it does not attract attention (Simons, Franconeri, & Reimer, 2000). -/- Failures of visual awareness have been induced in a number of ways. For example, observers often fail to report a visible but unexpected stimulus when attention is focused on some other object or event in the display (inattentional blindness). As for change blindness, inattentional blindness occurs for both simple (Mack & Rock, 1998; Most et al., 2001) and naturalistic stimuli (Simons & Chabris, 1999). Similarly, repeated instances of an item often go undetected when embedded in a rapid sequence (repetition blindness), a phenomenon that occurs for both words and pictures (Kanwisher, 1987; Kanwisher & Potter, 1990). Observers can also fail to detect a stimulus in a rapid stream of stimuli provided they had to perform an attention-demanding task shortly before the stimulus appeared (Shapiro, Arnell, & Raymond, 1997). The surprisingly large variety of conditions that induce failures of conscious perception reinforces the broad conclusion that we are often unaware of what would otherwise be fully-visible stimuli. -/- Along with an increased appreciation of the limitations of visual awareness has come a renewed interest in using these limitations to explore the nature of the representations and processes underlying our visual experience. Are these limitations due to failures of perception? Of attention? Of memory? What is preserved with and without awareness? -/- The papers in this special issue of the Journal of Vision provide examples of exciting new work on induced failures of visual awareness and the mechanisms that underlie them. For example, several papers examine whether observers are drawn to parts of a display by the stimulus features or whether top-down control or semantic comprehension influence search through a display. Others investigate the nature of and limits on the information that is preserved from one view to the next and how much information needs to be retained for effective perception and action. As guest editors, we hope that this special issue will illustrate how studying the relationship between visual awareness and visual representations can lead to important new insights into the nature of seeing. (shrink)

Freud proposes that in unconscious processing, logical connections are also (heavily) based upon phonological similarities. Repressed concerns, for example, would also be expressed by way of phonologic ambiguity. In order to investigate a possible unconscious influence of phonological similarity, 31 participants were submitted to a tachistoscopic subliminal priming experiment, with prime and target presented at 1ms. In the experimental condition, the prime and one of the 2 targets were phonological reversed forms of each other, though graphemically dissimilar (e.g., “nice” (...) and “sign”); in the control condition the targets were pseudo-randomly attributed to primes to which they don’t belong. The experimental task was to “blindly” pick the choice most similar to the prime. ERPs were measured with a focus on the N320, which is known to react selectively to phonological mismatch in supraliminal visual word presentations. The N320 amplitude-effects at the electrodes on the midline and at the left of the brain significantly predicted the participants’ net behavioral choices more than half a second later, while their subjective experience is one of arbitrariness. Moreover, the social desirability score (SDS) significantly correlates with both the behavioral and the N320 brain responses of the participants. It is proposed that in participants with low SDS the phonological target induces an expected reduction of N320 and this increases their probability to pick this target. In contrast, high defensive participants have a perplexed brain reaction upon the phonological target, with a negatively peaking N320 as compared to control and this leads them to avoid this target more often. Social desirability, which is understood as reflecting defensiveness, might also manifest itself as a defense against the (energy-consuming) ambiguity of language. The specificity of this study is that all of this is happening totally out of awareness and at the level of very elementary linguistic distinctions. (shrink)

Previous research with speech and non-speech stimuli suggested that in audiovisual perception, visual information starting prior to the onset of corresponding sound can provide visual cues, and form a prediction about the upcoming auditory sound. This prediction leads to audiovisual interaction. Auditory and visual perception interact and induce suppression and speeding up of the early auditory event-related potentials such as N1 and P2. To investigate AV interaction, previous research examined N1 and P2 amplitudes and latencies in (...) response to audio only, video only, audiovisual, and control stimuli, and compared AV with auditory perception based on four AV interaction models. The current study addresses how different models of AV interaction express N1 and P2 suppression in music perception. Furthermore, the current study took one step further and examined whether previous musical experience, which can potentially lead to higher N1 and P2 amplitudes in auditory perception, influenced AV interaction in different models. Musicians and non-musicians were presented the recordings of a keyboard /C4/ key being played, as well as CO stimuli. Results showed that AV interaction models differ in their expression of N1 and P2 amplitude and latency suppression. The calculation of model and has consequences for the resulting N1 and P2 difference waves. Furthermore, while musicians, compared to non-musicians, showed higher N1 amplitude in auditory perception, suppression of amplitudes and latencies for N1 and P2 was similar for the two groups across the AV models. Collectively, these results suggest that when visual cues from finger and hand movements predict the upcoming sound in AV music perception, suppression of early ERPs is similar for musicians and non-musicians. Notably, the calculation differences across models do not lead to the same pattern of results for N1 and P2, demonstrating that the four models are not interchangeable and are not directly comparable. (shrink)

We have shown that FEF lesion-induced extinction could be compensated for by changing the relative temporal onsets of two targets presented on either side of the midline. Monkeys were trained to make saccades to either of two identical visual stimuli presented with various stimulus onset asynchronies (SOA). In intact animals the targets were chosen with equal probability when they appeared simultaneously. After unilateral FEF lesions an SOA of 67–116 msec had to be introduced, with the contralesional target appearing (...) first, to obtain equal probability choice. With a smaller target separation, averaging saccades occurred with highest frequency at similar SOAs. Our findings suggest that neglect may be attributable to more time being required in the damaged hemisphere for converting sensory information into motor responses. (shrink)

Findings suggest a positive impact of bilingualism on cognition, including the later onset of dementia. However, it is not clear to what extent these effects are influenced by variations in attentional control demands in response to specific task requirements. In this study, 20 bilingual and 20 monolingual older adults performed a task-switching task under explicit task-cuing vs. memory-based switching conditions. In the cued condition, task switches occurred in random order and a visual cue signaled the next task to be (...) performed. In the memory-based condition, the task alternated after every second trial in a predictable sequence without presenting a cue. The performance of bilinguals did not vary across experimental conditions, whereas monolinguals experienced a pronounced increase in response latencies and error rates in the cued condition. Both groups produced similar switch costs and mixing costs, but bilinguals produced them with lower response latencies. The cognitive benefits of bilingualism seem not to apply to executive functions per se but to affect specific cognitive processes that involve task-relevant context processing. The present results suggest that lifelong bilingualism could promote in older adults a flexible adjustment to environmental cues, but only with increased task demands. However, due to the small sample size, the results should be interpreted with caution. (shrink)

People can maintain accurate representations of visual changes without necessarily being aware of them. Here, we investigate whether a similar phenomenon also exists in touch. In Experiments 1 and 2, participants detected the presence of a change between two consecutively-presented tactile displays. Tactile change blindness was observed, with participants failing to report the presence of tactile change. Critically, however, when participants had to make a forced choice response regarding the number of stimuli presented in the two displays, (...) their performance was significantly better than chance . Experiment 3 demonstrated that tactile change detection does not necessarily involve a shift of spatial attention toward the location of change, regardless of whether the change is explicitly detected. We conclude that tactile change detection likely results from comparing representations of the two displays, rather than by directing spatial attention to the location of the change. (shrink)

Previous research has demonstrated how emotion resembling cues in the face help shape impression formation. Perhaps most notable in the literature to date, has been work suggesting that gender-related appearance cues are visually confounded with certain stereotypic expressive cues. Only a couple studies to date have used computer vision to directly map out and test facial structural resemblance to emotion expressions using facial landmark coordinates to estimate face shape. In one study using a Bayesian network classifier trained to detect emotional (...) expressions structural resemblance to a specific expression on a non-expressive face was found to influence trait impressions of others. In another study, a connectionist model trained to detect emotional expressions found different emotion-resembling cues in male vs. female faces. Despite this seminal work, direct evidence confirming the theoretical assertion that humans likewise utilize these emotion-resembling cues when forming impressions has been lacking. Across four studies, we replicate and extend these prior findings using new advances in computer vision to examine gender-related, emotion-resembling structure, color, and texture and their impact on gender-stereotypic impression formation. We show that all three are meaningfully related to human impressions of emotionally neutral faces. Further when applying the computer vision algorithms to experimentally manipulate faces, we show that humans derive similar impressions from them as did the computer. (shrink)

Increasing behavioural evidence suggests that expert video game players (VGPs) show enhanced visual attention and visuospatial abilities, but what underlies these enhancements remains unclear. We administered the Poffenberger paradigm with concurrent electroencephalogram (EEG) recording to assess occipital N1 latencies and interhemispheric transfer time (IHTT) in expert VGPs. Participants comprised 15 right-handed male expert VGPs and 16 non-VGP controls matched for age, handedness, IQ and years of education. Expert VGPs began playing before age 10, had a minimum 8 years experience, (...) and maintained playtime of at least 20 hours per week over the last 6 months. Non-VGPs had little-to-no game play experience (maximum 1.5 years). Participants responded to checkerboard stimuli presented to the left and right visual fields while 128-channel EEG was recorded. Expert VGPs responded significantly more quickly than non-VGPs. Expert VGPs also had significantly earlier occipital N1s in direct visual pathways (the hemisphere contralateral to the visual field in which the stimulus was presented). IHTT was calculated by comparing the latencies of occipital N1 components between hemispheres. No significant between-group differences in electrophysiological estimates of IHTT were found. Shorter N1 latencies may enable expert VGPs to discriminate attended visual stimuli significantly earlier than non-VGPs and contribute to faster responding in visual tasks. As successful video-game play requires precise, time pressured, bimanual motor movements in response to complex visual stimuli, which in this sample began during early childhood, these differences may reflect the experience and training involved during the development of video-game expertise, but training studies are needed to test this prediction. (shrink)

The behavioral immune system (BIS) includes perceptual mechanisms for detecting cues of contamination. Former studies have indicated that moisture has a disgusting property. Therefore, moisture could be a target for detecting contamination cues by the BIS. We conducted two experiments to examine the psychophysical basis of moisture perception and clarify the relationship between the perception of moisture and the BIS. We assumed that the number of high luminance areas in a visual image provided optical information that would enable the (...) visual perception of moisture. In two experiments, we presented eight images of dough that contained different amounts of moisture as experimental stimuli. The amount of moisture shown in the images was increased in eight steps, from 28.6% to 42.9% of the total weight of the dough. In Experiment 1, the images were randomly presented on a computer display, and the participants (n = 22) were asked to rank the images in the order of the visually perceived moisture content. In Experiment 2, the participants (n = 15) completed pairwise comparisons based on the perceived moistness of the images. Furthermore, to examine the BIS responses, the participants rated the strength of disgust evoked by the stimuli, their motivation to avoid touching the stimuli, and the estimated magnitude of the risk of contamination by physical contact with the stimuli. The results indicated that the moisture content and the numbers of high luminance areas in the images accurately predicted the perception of moisture, suggesting that the detection of visual moisture was highly accurate, and the optical information served as an essential perceptual cue for detecting moisture. On the other hand, the BIS responses peaked in response to stimuli having approximately 33% to 39% moisture content. These results show that objects containing a moderate amount of moisture could be the target of visually detecting pathogens by the BIS. (shrink)

One of the more compelling beliefs about vision is that it is based on representations that are coherent and complete, with everything in the visual field described in great detail. However, changes made during a visual disturbance are found to be difficult to see, arguing against the idea that our brains contain a detailed, picture-like representation of the scene. Instead, it is argued here that a more dynamic, "just-in-time" representation is involved, one with deep similarities to the way (...) that users interact with external displays. It is further argued that these similarities can provide a basis for the design of intelligent display systems that can interact with humans in highly effective and novel ways. (shrink)

Participants who were unable to detect familiarity from masked 17 ms faces did report a vague, partial visual percept. Two experiments investigated the relative strength of the visual percept generated by famous and unfamiliar faces, using masked 17 ms exposure. Each trial presented simultaneously a famous and an unfamiliar face, one face in LVF and the other in RVF. In one task, participants responded according to which of the faces generated the stronger visual percept, and in the (...) other task, they attempted an explicit familiarity decision. The relative strength of the visual percept of the famous face compared to the unfamiliar face was moderated by response latency and participants’ attitude towards the famous person. There was also an interaction of visual field with response latency, suggesting that the right hemisphere can generate a visual percept differentiating famous from unfamiliar faces more rapidly than the left hemisphere. Participants were at chance in the explicit familiarity decision, confirming the absence of awareness of facial familiarity. (shrink)

Synchronized movements with external periodic rhythms, such as dancing to a beat, are commonly observed in daily life. Although it has been well established that some vocal learning species (including parrots and humans) spontaneously develop this ability, it has only recently been shown that monkeys are also capable of predictive and tempo-flexible synchronization to periodic stimuli. In our previous study, monkeys were trained to make predictive saccades for alternately presented visual stimuli at fixed stimulus onset asynchronies (SOAs) (...) to obtain a liquid reward. The monkeys generalized predictive synchronization to novel SOAs in the middle of trained range, suggesting a capacity for tempo-flexible synchronization. However, it is possible that when encountering a novel tempo, the monkeys might sample learned saccade sequences from those for the short and long SOAs so that the mean saccade interval matched the untrained SOA. To eliminate this possibility, in the current study we tested monkeys on novel SOAs outside the trained range. Animals were trained to generate synchronized eye movements for 600 and 900-ms SOAs for a few weeks, and then were tested for longer SOAs. The accuracy and precision of predictive saccades for one untrained SOA (1200 ms) were comparable to those for the trained conditions. On the other hand, the variance of predictive saccade latency and the proportion of reactive saccades increased significantly in the longer SOA conditions (1800 and 2400 ms), indicating that temporal prediction of periodic stimuli was difficult in this range, similar to previous results on synchronized tapping in humans. Our results suggest that monkeys might share similar synchronization mechanisms with humans, which can be subject to physiological examination in future studies. (shrink)

Languages differ systematically in how to encode a motion event. English characteristically expresses manner in verb root and path in verb particle; in Chinese, varied aspects of motion, such as manner, path and cause, can be simultaneously encoded in a verb compound. This study investigates whether typological differences, as such, influence how first and second language learners conceptualise motion events, as suggested by behavioural evidences. Specifically, the performance of Chinese learners of English, at three proficiencies, was compared to that of (...) two groups of monolingual speakers in a triads matching task. The first set of analyses regarding categorisation preferences indicates that participants across groups preferred the path-matched (rather than manner-matched) screens. However, the second set of analyses regarding reaction time suggests, firstly, that English monolingual speakers reacted significantly more quickly in selecting the manner-matched scenes compared with monolingual speakers of Chinese, who tended to use an approximately equal amount of time in making manner- and path-matched decisions, a finding that can arguably be mapped onto the typological difference between the two languages. Secondly, the pattern of response latency in low-level L2 learners looked more like that of monolingual speakers of Chinese. Only at intermediate and advanced levels of acquisition did the behavioural pattern of L2 learners become target-like, thus suggesting language-specific constraints from the L1 at an early stage of acquisition. Overall, our results suggest that motion event cognition may be linked to, among other things, the linguistic structure of motion description in particular languages. (shrink)

Previous studies have shown that the human visual system can detect a face and elicit a saccadic eye movement toward it very efficiently compared to other categories of visual stimuli. In the first experiment, we tested the influence of facial expressions on fast face detection using a saccadic choice task. Face‐vehicle pairs were simultaneously presented and participants were asked to saccade toward the target (the face or the vehicle). We observed that saccades toward faces were initiated (...) faster, and more often in the correct direction, than saccades toward vehicles, regardless of the facial expressions (happy, fearful, or neutral). We also observed that saccade endpoints on face images were lower when the face was happy and higher when it was neutral. In the second experiment, we explicitly tested the detection of facial expressions. We used a saccadic choice task with emotional‐neutral pairs of faces and participants were asked to saccade toward the emotional (happy or fearful) or the neutral face. Participants were faster when they were asked to saccade toward the emotional face. They also made fewer errors, especially when the emotional face was happy. Using computational modeling, we showed that this happy face advantage can, at least partly, be explained by perceptual factors. Also, saccade endpoints were lower when the target was happy than when it was fearful. Overall, we suggest that there is no automatic prioritization of emotional faces, at least for saccades with short latencies, but that salient local face features can automatically attract attention. (shrink)

Cultural similarities and differences in facial expressions have been a controversial issue in the field of facial communications. A key step in addressing the debate regarding the cultural dependency of emotional expression is to characterize the visual features of specific facial expressions in individual cultures. Here we developed an image analysis framework for this purpose using convolutional neural networks that through training learned visual features critical for classification. We analyzed photographs of facial expressions derived from two databases, each (...) developed in a different country, in which corresponding emotion labels were available. While the CNNs reached high rates of correct results that were far above chance after training with each database, they showed many misclassifications when they analyzed faces from the database that was not used for training. These results suggest that facial features useful for classifying facial expressions differed between the databases. The selectivity of computational units in the CNNs to action units of the face varied across the facial expressions. Importantly, the AU selectivity often differed drastically between the CNNs trained with the different databases. Similarity and dissimilarity of these tuning profiles partly explained the pattern of misclassifications, suggesting that the AUs are important for characterizing the facial features and differ between the two countries. The AU tuning profiles, especially those reduced by principal component analysis, are compact summaries useful for comparisons across different databases, and thus might advance our understanding of universality vs. specificity of facial expressions across cultures. (shrink)

Audio description remains the cornerstone of accessibility for visually impaired audiences to all sorts of audiovisual content, including porn. Existing work points to the efficacy of audio description to guarantee immersion and emotional engagement, but evidence on its role in sexual arousal and engagement in porn is still scant. The present study takes on this challenge by comparing sighted and visually impaired participants’ experiences with porn in terms of their physiological response [i.e., cortisol and heart rate ] and self-report measures (...) of affect [Positive and Negative Affect Schedule ; Watson et al., 1988], anxiety [State-Trait Anxiety Inventory ; Spielberger et al., 1970], sexual reactivity and arousal [Sexual Inhibition/Sexual Excitation Scale ; Moyano and Sierra ; and the Ratings of Sexual Arousal ; Mosher ], and narrative engagement or transportation [The Transport Narrative Questionnaire, Green and Brock ]. 69 Spanish participants were allocated into three different groups: 25 sighted participants who watched and heard the porn scenes in their audio-visual version ; 22 sighted participants who listened to the audio described version without images ; and 22 visually impaired participants who also listened to the audio described version without images. Overall, results on physiological and self-report measures revealed no significant differences between groups or different versions of the clips. The analysis of cortisol reactivity to porn as the maximum increase or decrease in cortisol with respect to baseline values revealed no significant differences between the groups, but pointed to a higher percentage of non-responders than responders in the three groups, the highest being found in the ONCE group. As for participants’ cardiac response to the clips, no significant differences were found across the groups, with the highest HR levels being registered in the baseline phase. Self-report measures revealed significant between-group differences in negative affect. The ONCE group displayed the highest pre-task levels of negative affect and was the only group that showed a decrease in negative affect after exposure to the clips. Sighted and visually impaired participants reported to be moderately aroused and immersed in the films, regardless of exposure to AV or AD porn. In addition, correlations found between participants’ levels of self-report sexual arousal and transportation and post-task affect pointed to a positive relationship between exposure to porn and perceived levels of sexual arousal and affect. Results from the study reflected the efficacy of audio description in providing sighted and visually impaired audiences with a similar experience to that offered by original AV porn scenes. This study is exploratory but provides valid, initial groundwork for further research on the impact of audio description on porn reception. (shrink)

This study investigates the effects of visual mnemonics and the methods of presenting learning materials on learning visually similar characters for Chinese-as-second-language learners. In supporting CSL learners to build robust orthographic representations in Chinese, addressing the challenges of visual similarity of characters is an important issue. Based on prior research on perceptual learning, we tested three strategies that differ in the extent to which they promote interrelated attention to the form and meaning of characters: Stroke Sequence, a (...) form-emphasis strategy, Key-images, a form + meaning strategy utilizing visual code, Pithy Formulas with Key-images, a form + meaning strategy combining visual and verbal codes. A pretest–posttest equivalent-group design was adopted. The independent variables were the learning strategy, the method of presenting character pairs, and testing time. The dependent variables were learners’ proportions of accurate responses to reading and writing Chinese characters through a posttest and a delayed posttest ; a learner experience survey was also administered to investigate learners’ opinions on each strategy. Sixty-six non-beginning learners of Chinese participated; they were randomly assigned to one of the two groups in which participants learned ten characters via the three strategies, respectively, differing between whether the characters were presented in similar pairs or dissimilar pairs. Data were analyzed via three-way ANCOVAs. The Pithy Formulas with Key-images and the Key-images generally yielded higher writing accuracy than Stroke Sequence immediately after learning. Notably, the advantage of the Pithy Formulas with Key-images over the Key-images on writing was specific to the participants that learned with visually similar pairs rather than those that learned with dissimilar pairs. All strategies were effective for reading, yet learners’ experience ratings favored the two form + meaning strategies over the strategy that focused primarily on form. Suggestions for future research and pedagogical implications on learning visually similar characters were offered. (shrink)

Blindsight is classically defined as residual visual capacity, e.g., to detect and identify visual stimuli, in the total absence of perceptual awareness following lesions to V1. However, whereas most experiments have investigated what blindsight patients can and cannot do, the literature contains several, often contradictory, remarks about remaining visual experience. This review examines closer these remarks as well as experiments that directly approach the nature of possibly spared visual experiences in blindsight.

A detection task was performed using different pictographic representations of objects in order to test the hypothesis that high-level information (familiarity) may influence detection thresholds. The stimuli were five versions of forms: outline drawings of objects, silhouettes, and three fragmented versions of forms derived from the outlines. The stimuli varied on two parameters: their nameability (easily nameable, hardly nameable, and not nameable) as assessed by a naming task, and their energy content as assessed by a two-dimensional (...) fast-Fourier transform. The greatest amount of energy was observed for silhouettes, and the amount of energy contained in the vertical and horizontal spatial frequency components was equivalent for outlines and the three versions of fragmented forms. Luminance thresholds for the detection of the forms were measured by means of an adaptive method. The results show that thresholds were determined only by the energy content of the stimuli. High-level semantic or name information had no influence on the detectability of the visual signal. The results are discussed in terms of the visibility of spatial frequency components at detection threshold. (shrink)

Current cognitive models of addiction imply that speeded detection and increased distraction from substance cues might both independently contribute to the persistence of addictive behavior. Speeded detection might lower the threshold for experiencing craving, whereas increased distraction might further increase the probability of entering a bias-craving-bias cycle, thereby lowering the threshold for repeated substance use. This study was designed to examine whether indeed both attentional processes are involved in substance use disorders. Both attentional processes were indexed by an (...) Odd-One-Out visual search task in individuals diagnosed with alcohol use disorder and cannabis use disorder. To test whether the detection and/or the distraction component are characteristic for AUD and CUD, their indices were compared with matched individuals without these diagnoses. Individuals with CUD showed speeded detection of cannabis cues; the difference in detection between AUD and the comparison group remained inconclusive. Neither the AUD nor the CUD group showed more distraction than the comparison groups. The sample size of the CUD group was relatively small. In addition, participants made relatively many errors in the attentional bias task, which might have lowered its sensitivity to detect ABs. The current study provided no support for the proposed role of increased distraction in CUD and AUD. The findings did, however, provide support for the view that speeded detection might be involved in CUD. Although a similar trend was evident for AUD, the evidence was weak and remained therefore inconclusive. (shrink)

The recent emergence of machine-manipulated media raises an important societal question: How can we know whether a video that we watch is real or fake? In two online studies with 15,016 participants, we present authentic videos and deepfakes and ask participants to identify which is which. We compare the performance of ordinary human observers with the leading computer vision deepfake detection model and find them similarly accurate, while making different kinds of mistakes. Together, participants with access to the model’s (...) prediction are more accurate than either alone, but inaccurate model predictions often decrease participants’ accuracy. To probe the relative strengths and weaknesses of humans and machines as detectors of deepfakes, we examine human and machine performance across video-level features, and we evaluate the impact of preregistered randomized interventions on deepfake detection. We find that manipulations designed to disrupt visual processing of faces hinder human participants’ performance while mostly not affecting the model’s performance, suggesting a role for specialized cognitive capacities in explaining human deepfake detection performance. -/- . (shrink)

Countless studies have reported that individuals detect threatening/angry faces faster than happy/neutral faces. Two classic views have been used to explain this phenomenon—that negative valence drives the effect, or conversely, that low-level perceptual characteristics of the stimuli are responsible for their rapid detection. In the current review, I question whether dichotomous perspectives are the most parsimonious way to explain a large and inconsistent literature. Further, I argue that nondichotomous, multicomponent accounts for the detection of emotionally valenced (...) class='Hi'>stimuli might help take us beyond traditional approaches to visual detection research, and I suggest various ways in which future research can use these newer approaches to more effectively elucidate the mechanisms underlying the rapid detection of emotionally valenced stimuli. (shrink)

Vision often dominates other perceptual modalities both at the level of experience and at the level of judgment. In the well-known McGurk effect, for example, one’s auditory experience is consistent with the visual stimuli but not the auditory stimuli, and naïve subjects’ judgments follow their experience. Structurally similar effects occur for other modalities (e.g. rubber hand illusions). Given the robustness of this visual dominance, one might not be surprised that visual imagery often dominates imagery (...) in other modalities. One might be surprised, however, that visual imagery often dominates perception in other modalities. This more controversial claim is motivated both by empirical data and by introspection. Some think of perception-perception visual dominance as epistemically good, holding that cases in which visual dominance misleads us (e.g. McGurk and rubber hand illusions) are cases in which the perceptual system resolves conflicts according to principles that are generally reliable. Here, we explore support for the more controversial claim that imagery-perception visual dominance is epistemically good. We suggest that, when the task is richly spatial, requiring for optimal performance the all-at-once identification of macro-spatial and allocentric properties (e.g. identifying the shape or location of a felt or heard object), the visual, whether perception or imagination, should dominate other modalities. Put another way, when identifying objects, one should go and look or, short of that, visually imagine candidate objects, and then follow the visual, even against conflicting perceptions from other modalities. For this broadly-typed category of of cognitive-perceptual task, vision does dominate and it should. (shrink)

How does the compositional arrangement of elements in a complex image, like a diagram, a picture or a map, represent the structural features of its content? In this paper I argue that they do so iconically, through the exploitation of relations of visual similarity and dissimilarity. I develop the general claim that our interpretation of this sort of images is guided by the implicit defeasible assumption that things that are patently related represent things that are relevantly related in a (...) similar way. I also identify the usual intrinsic and extrinsic mechanisms we use to represent structural features and illustrate them with an example from real life: a recent infographic from a popular science magazine. (shrink)

The capacity of visual working memory (VWM) refers to the amount of visual information that can be maintained in mind at once, readily accessible for ongoing tasks. In healthy young adults, the capacity limit of VWM corresponds to about three simple objects. While some researchers argued that VWM capacity becomes adult-like in early years of life, others claimed that the capacity of VWM continues to develop beyond middle childhood. Here we assessed whether VWM capacity reaches adult levels in (...) adolescence. Using an adaptation of the visual change detection task, we measured visual working memory capacity estimates in 13 year-olds, 16-year-olds, and young adults. We tested whether the capacity estimates observed in early or later years of adolescence were comparable to the estimates obtained from adults. Our results demonstrated that the capacity of VWM continues to develop throughout adolescence, not reaching adult levels even in 16 year-olds. These findings suggest that VWM capacity displays a prolonged development, similar to the protracted trajectories observed in various other aspects of cognition. (shrink)