How should we measure metacognitive sensitivity, i.e. the efficacy with which observers’ confidence ratings discriminate between their own correct and incorrect stimulus classifications? We argue that currently available methods are inadequate because they are influenced by factors such as response bias and type 1 sensitivity . Extending the signal detection theory approach of Galvin, Podd, Drga, and Whitmore , we propose a method of measuring type 2 sensitivity that is free from these confounds. We call our measure meta-d′, which reflects (...) how much information, in signal-to-noise units, is available for metacognition. Applying this novel method in a 2-interval forced choice visual task, we found that subjects’ metacognitive sensitivity was close to, but significantly below, optimality. We discuss the theoretical implications of these findings, as well as related computational issues of the method. We also provide free Matlab code for implementing the analysis. (shrink)

To find the neural substrates of consciousness, researchers compare subjects’ neural activity when they are aware of stimuli against neural activity when they are not aware. Ideally, to guarantee that the neural substrates of consciousness—and nothing but the neural substrates of consciousness—are isolated, the only difference between these two contrast conditions should be conscious awareness. Nevertheless, in practice, it is quite challenging to eliminate confounds and irrelevant differences between conscious and unconscious conditions. In particular, there is an often-neglected confound that (...) is crucial to eliminate from neuroimaging studies: task performance. Unless subjects’ task performance is matched (and hence perceptual signal processing is matched), researchers risk finding the neural correlates of perception, rather than conscious perception. Here, we discuss the theoretical motivations for the performance matching framework and review empirical demonstrations of, and theoretical inferences derived from, obtaining differences in consciousness while controlling for task performance. We summarize signal detection theoretic modeling frameworks that explain how it is that we can derive performance-matched differences in consciousness without the effect being trivially driven by differences in criterion setting, and also provide principles for designing experimental paradigms that yield performance-matched differences in awareness. Finally, we address potential technical and theoretical issues that stem from matching performance across conditions of awareness, and we introduce the notion of “triangulation” for designing comprehensive experimental sets that can better reveal the neural substrates of consciousness. (shrink)

When visual attention is directed away from a stimulus, neural processing is weak and strength and precision of sensory data decreases. From a computational perspective, in such situations observers should give more weight to prior expectations in order to behave optimally during a discrimination task. Here we test a signal detection theoretic model that counter-intuitively predicts subjects will do just the opposite in a discrimination task with two stimuli, one attended and one unattended: when subjects are probed to discriminate the (...) unattended stimulus, they rely less on prior information about the probed stimulus’ identity. The model is in part inspired by recent findings that attention reduces trial-by-trial variability of the neuronal population response and that they use a common criterion for attended and unattended trials. In five different visual discrimination experiments, when attention was directed away from the target stimulus, subjects did not adjust their response bias in reaction to a change in stimulus presentation frequency despite being fully informed and despite the presence of performance feedback and monetary and social incentives. This indicates that subjects did not rely more on the priors under conditions of inattention as would be predicted by a Bayes-optimal observer model. These results inform and constrain future models of Bayesian inference in the human brain. (shrink)

Confidence can dissociate from perceptual accuracy, suggesting distinct computational and neural processes underlie these psychological functions. Recent investigations have therefore sought to experimentally isolate metacognitive processes by creating conditions where perceptual sensitivity is matched but confidence differs (“matched-performance / different-confidence”; MPDC). Despite these endeavors’ success, much remains unknown about MPDC effects and how to best harness them in experimental settings. Here we developed a principled approach to comprehensively characterizing MPDC effects through analyzing metaperceptual (i.e., type 2 psychometric) functions relating objective (...) performance to subjective confidence across widely varying performance levels and experimental manipulations. We found that MPDC effect magnitude depends on stimulus properties, observers’ sensitivity level, and critically on trial type order (blocked or interleaved across stimulus property variations). Our findings provide the first comprehensive exploration of MPDC effects, offer a prescriptive guide to metaperceptual analysis, and suggest optimal experimental paradigms for experimentally isolating metacognition and awareness in future studies. (shrink)