The standard interpretation of cognitive reflection tests assumes that correct responses are reflective and lured responses are unreflective. However, prior process-tracing of mathematical reflection tests has cast doubt on this interpretation. In two studies (N = 201), we deployed a validated think-aloud protocol in-person and online to test how this assumption is satisfied by the new, validated, less familiar, and less mathematical verbal Cognitive Reflection Test (vCRT). Importantly, thinking aloud did not disrupt test performance compared to a control group. Moreover, (...) verbalized thoughts in both studies revealed that most (but not all) correct responses involved reflection and that most (but not all) lured responses lacked reflection. These data suggest that the vCRT usually satisfies the standard interpretation of the reflection tests (albeit not without exceptions) and that the vCRT can be a good measure of the construct theorized by the two-factor explication of ‘reflection’ (as deliberate and conscious). (shrink)

Prior research has suggested that perceptual disfluency activates analytical processing and increases the solution rate of mathematical problems with appealing but incorrect answers (i.e., the Cogn...

Past research suggests that people process verbal quantifiers differently from numerical ones, but this suggestion has yet to be formally tested. Drawing from traditional correlates of dual-process...

De Neys proposes an elegant solution to several theoretical problems of the dual-process theories but underspecifies the role of motivation in initiating, intensifying, and ceasing deliberation. Therefore, I suggest including a meta-cognitive control component in the working model that can moderate deliberation, for instance by affecting the deliberation threshold.