Deliberative thinking often consists of several steps, each involving a switch decision. These decisions may be influenced by confidence in the thinking done so far. Individuals may differ in their tolerance of low confidence and thus may arrive at unjustified high confidence too soon, either from trusting their intuition or by bolstering an initially favored conclusion.

ABSTRACTIn two experiments, we examined the resolution of confidence judgments in syllogistic reasoning and their heuristic bases. Based on the assumptions of Koriat's Self-Consistency Model of confidence, we expected the confidence judgments to be related to conclusion consensuality, reflecting the role of consistency as a heuristic cue to confidence. In Experiment 1, the participants evaluated 24 syllogisms with conclusions that varied with respect to validity and consensuality. In Experiment 2, the participants produced conclusions to 64 pairs of premises. The correlation (...) between confidence and reasoning accuracy was low. In both experiments confidence was related to the consensuality of the responses. For consensually correct items, correlation between confidence and accuracy was positive; however, for consensually incorrect items it was negative. In Experiment 2, confidence was lower for syllogisms with higher response cardinality, or syllogisms that elicited a greater variety of conclusions. (shrink)

Influential work on reasoning and decision-making has popularised the idea that sound reasoning requires correction of fast, intuitive thought processes by slower and more demanding deliberation. We present seven studies that question this corrective view of human thinking. We focused on the very problem that has been widely featured as the paradigmatic illustration of the corrective view, the well-known bat-and-ball problem. A two-response paradigm in which people were required to give an initial response under time pressure and cognitive load allowed (...) us to identify the presumed intuitive response that preceded the final response given after deliberation. Across our studies, we observe that correct final responses are often non-corrective in nature. Many reasoners who manage to answer the bat-and-ball problem correctly after deliberation already solved it correctly when they reasoned under conditions that minimised deliberation in the initial response phase. This suggests that sound bat-and-ball reasoners do not necessarily need to deliberate to correct their intuitions; their intuitions are often already correct. Pace the corrective view, findings suggest that in these cases, they deliberate to verify correct intuitive insights. (shrink)

Philosophers tend to be pretty impressed by human self-knowledge. Descartes (1641/1984) thought our knowledge of our own stream of experience was the secure and indubitable foundation upon which to build our knowledge of the rest of the world. Hume – who was capable of being skeptical about almost anything – said that the only existences we can be certain of are our own sensory and imagistic experiences (1739/1978, p. 212). Perhaps the most prominent writer on self-knowledge in contemporary philosophy is (...) Sydney Shoemaker. The central aim of much of his work has been to show that certain sorts of error are impossible (1963, 1988, 1994). David Chalmers has likewise attempted to show that, for a suitably constrained class of beliefs about one’s own consciousness, error is impossible (2003, sec. 4.1). Even philosophers most of the community thinks of as pessimistic about self-knowledge of consciousness seem to me, really, to be fairly optimistic. Paul Churchland, famous for his disdain of ordinary people’s knowledge about the mind, compares the accuracy of introspection to the accuracy of sense perception – pretty good, presumably, about medium-sized, nearby matters (1985, 1988). Dan Dennett, often cited as a pessimist about introspective report, actually says that we can come close to infallibility when charitably interpreted (2002). The above references concern knowledge of the stream of conscious experience, but philosophers have also tended to be impressed with our self-knowledge of our attitudes, such as our beliefs and desires. Consider this: Although I can be wrong about its being sunny outside, I can’t in the same way be wrong, it seems, about the fact that I think it’s sunny outside. Some.. (shrink)

Although widely studied in other domains, relatively little is known about the metacognitive processes that monitor and control behaviour during reasoning and decision-making. In this paper, we examined the conditions under which two fluency cues are used to monitor initial reasoning: answer fluency, or the speed with which the initial, intuitive answer is produced, and perceptual fluency, or the ease with which problems can be read. The first two experiments demonstrated that answer fluency reliably predicted Feeling of Rightness judgments to (...) conditional inferences and base rate problems, which subsequently predicted the amount of deliberate processing as measured by thinking time and answer changes; answer fluency also predicted retrospective confidence judgments. Moreover, the effect of answer fluency on reasoning was independent from the effect of perceptual fluency, establishing that these are empirically independent constructs. In five experiments with a variety of reasoning problems similar to those of Alter et al., we found no effect of perceptual fluency on FOR, retrospective confidence or accuracy; however, we did observe that participants spent more time thinking about hard to read stimuli, although this additional time did not result in answer changes. In our final two experiments, we found that perceptual disfluency increased accuracy on the CRT, but only amongst participants of high cognitive ability. As Alter et al.’s samples were gathered from prestigious universities, collectively, the data to this point suggest that perceptual fluency prompts additional processing in general, but this processing may results in higher accuracy only for the most cognitively able. (shrink)

Using normative correctness as a diagnostic tool reduces the outcome of complex cognitive functions to a binary classification (normative or non-normative). It also focuses attention on outcomes, rather than processes, impeding the development of good cognitive theories. Given that both normative and non-normative responses may be produced by the same process, normativity is a poor indicator of underlying processes.

We tested the hypothesis that choices determined by Type 1 processes are compelling because they are fluent, and for this reason they are less subject to analytic thinking than other answers. A total of 104 participants completed a modified version of Wason's selection task wherein they made decisions about one card at a time using a two-response paradigm. In this paradigm participants gave a fast, intuitive response, rated their feeling of rightness for that response, and were then allowed free time (...) to reconsider their answers. As we predicted, answers consistent with a matching heuristic were made more quickly than other answers, were given higher FOR ratings, and received less subsequent analysis as measured by rethinking time and the probability of changing answers. These data suggest that reasoning biases may be compelling because they are fluently generated; this is turn creates a strong FOR, which acts as a signal that further analysis is not necessary. (shrink)

One hundred and three participants solved conflict and non-conflict versions of four reasoning tasks using a two-response procedure: a base rate task, a causal reasoning task, a denominator neglect task, and a categorical syllogisms task. Participants were asked to give their first, intuitive answer, to make a Feeling of Rightness judgment, and then were given as much time as needed to rethink their answer. They also completed a standardized measure of IQ and the actively open-minded thinking questionnaire. The FORs of (...) both high- and low-capacity reasoners were responsive to conflict, such that FORs were lower for conflict relative to non-conflict problems. Consistent with the quantity hypothesis, high-capacity reasoners made a greater distinction between conflict and non-conflict items on measures of Type 2 thinking, namely, rethinking time and probability of changing answers. In contrast to the quality hypothesis, however, this rethinking time did not advantage the ability of the high-capacity group to produce normative answers, except for the base rate task. Indeed, we observed that the correlation between capacity and the probability of normative answers emerged at the initial response, rather than after rethinking. (shrink)

A major challenge for Dual Process Theories of reasoning is to predict the circumstances under which intuitive answers reached on the basis of Type 1 processing are kept or discarded in favour of analytic, Type 2 processing (Thompson 2009 ). We propose that a key determinant of the probability that Type 2 processes intervene is the affective response that accompanies Type 1 processing. This affective response arises from the fluency with which the initial answer is produced, such that fluently produced (...) answers give rise to a strong feeling of rightness. This feeling of rightness, in turn, determines the extent and probability with which Type 2 processes will be engaged. Because many of the intuitions produced by Type 1 processes are fluent, it is common for them to be accompanied by a strong sense of rightness. However, because fluency is poorly calibrated to objective difficulty, confidently held intuitions may form the basis of poor quality decisions. (shrink)

(2013). Matching bias in syllogistic reasoning: Evidence for a dual-process account from response times and confidence ratings. Thinking & Reasoning: Vol. 19, No. 1, pp. 54-77. doi: 10.1080/13546783.2012.735622.

1. Overconfidence is usually understood as being more confident than reality justifies (Harvey, 1997; Moore & Healy, 2008; Pompian, 2006), which leads individuals to overestimate their performance...

Normative theories can be useful in developing descriptive theories, as when normative subjective expected utility theory is used to develop descriptive rational choice theory and behavioral game theory. “Ought” questions are also the essence of theories of moral reasoning, a domain of higher mental processing that could not survive without normative considerations.

Recent research shows that in reasoning tasks, subjects usually produce an initial intuitive answer, accompanied by a metacognitive experience, which has been called feeling of rightness. This paper is aimed at exploring the complimentary experience of feeling of error, that is, the spontaneous, subtle sensation of cognitive uneasiness arising from conflict detection during thinking. We investigate FOE in two studies with the “bat-and-ball” reasoning task, in its standard and isomorphic control versions. Study 1 is a generation study, in which participants (...) are asked to generate their own response. Study 2 is an evaluation study, in which participants are asked to choose between two conflicting answers. In each study, the FOE is measured by the FOE questionnaire. Results show that the FOE is significantly present in the standard B&B task when participants give a wrong answer, that our questionnaire can measure it, and furthermore, that it is diagnostic of genuine error. (shrink)

This paper provides new tools for philosophical argument analysis and fresh empirical foundations for ‘critical’ ordinary language philosophy. Language comprehension routinely involves stereotypical inferences with contextual defeaters. J.L. Austin’s Sense and Sensibilia first mooted the idea that contextually inappropriate stereotypical inferences from verbal case-descriptions drive some philosophical paradoxes; these engender philosophical problems that can be resolved by exposing the underlying fallacies. We build on psycholinguistic research on salience effects to explain when and why even perfectly competent speakers cannot help making (...) stereotypical inferences which are contextually inappropriate. We analyse a classical paradox about perception, suggest it relies on contextually inappropriate stereotypical inferences from appearance-verbs, and show that the conditions we identified as leading to contextually inappropriate stereotypical inferences are met in formulations of the paradox. Three experiments use a forced-choice plausibility-ranking task to document the predicted inappropriate inferences, in English, German, and Japanese. The cross-linguistic study allows us to assess the wider relevance of the proposed analysis. Our findings open up new perspectives for ‘evidential’ experimental philosophy. (shrink)

Dual-process theories of higher cognition, distinguishing between intuitive (Type 1) and reflective (Type 2) thinking, have become increasingly popular, although also subject to recent criticism. A key question, to which a number of contributions in this special issue relate, is how to define the difference between the two kinds of processing. One issue discussed is whether they differ at Marr’s computational level of analysis. I believe they do but that ultimately the debate will decided at the implementational level where distinct (...) cognitive and neural systems need to be demonstrated. Other distinctions raised in the issue are the unique ability for metarepresentation, cognitive decoupling and hypothetical thinking at the Type 2 level, and the association of emotion and metacognitive feelings with the Type 1 level. The relation of the latter to cognitive control is also discussed. (shrink)

Our target article identified normativism as the view that rationality should be evaluated against unconditional normative standards. We believe this to be entrenched in the psychological study of reasoning and decision making and argued that it is damaging to this empirical area of study, calling instead for a descriptivist psychology of reasoning and decision making. The views of 29 commentators (from philosophy and cognitive science as well as psychology) were mixed, including some staunch defences of normativism, but also a number (...) that were broadly supportive of our position, although critical of various details. In particular, many defended a position that we call which sees a role for normative evaluation within boundaries alongside more descriptive research goals. In this response, we clarify our use of the term and add discussion of defining both as descriptive and non-normative concepts. We consider the debate with reference to dual-process theory, the psychology of reasoning, and empirical research strategy in these fields. We also discuss cognitive variation by age, intelligence, and culture, and the issue of relative versus absolute definitions of norms. In conclusion, we hope at least to have raised consciousness about the important boundaries between norm and description in the psychology of thinking. (shrink)

In common with a number of other authors I believe that there has been a paradigm shift in the psychology of reasoning, specifically the area traditionally labelled as the study of deduction. The deduction paradigm was founded in a philosophical tradition that assumed logicality as the basis for rational thought, and provided binary propositional logic as the agreed normative framework. By contrast, many contemporary authors assume that people have degrees of uncertainty in both premises and conclusions, and reject binary logic (...) as a workable normative system. I discuss a number of questions and challenges for this new psychology of reasoning, including the following: (a) Do we need an alternative normative system, such as Bayesianism, for the new paradigm? (b) Is there any longer a clear distinction between the study of deductive and inductive reasoning, the latter having its own tradition and literature? (c) Precisely how is the integrated study of reasoning and decision making facilitated by the new paradigm? (d) What difficulties with dual-processing approaches need to be resolved, if they are to take us forward? (shrink)

We conducted a thorough investigation of the impact of representativeness on reasoning and metacognitive processes by employing the Linda problem. In congruent versions, the more representative res...

Recent work in cognitive modelling has found that most of the data that has been cited as evidence for the dual-process theory (DPT) of reasoning is best explained by non-linear, “monotonic” one-process models (Stephens et al., 2018, 2019). In this paper, I consider an important caveat of this research: it uses models that are committed to unrealistic assumptions about how effectively task conditions can isolate Type-1 and Type-2 reasoning. To avoid this caveat, I develop a coordinated theoretical, experimental, and modelling (...) strategy to better test DPT. First, I propose that Type-1 and Type-2 reasoning are defined as reasoning that precedes and follows metacognitive control, respectively. Second, I argue that reasoning that precedes and follows metacognitive control can be effectively isolated using debiasing paradigms that manipulate metacognitive heuristics (e.g., processing fluency) to prevent or trigger metacognitive control, respectively. Third, I argue that monotonic modelling can allow us to decisively test DPT only when we use them to analyse data from this particular kind of debiasing paradigm. (shrink)

Cognitive scientists have revealed systematic errors in human reasoning. There is disagreement about what these errors indicate about human rationality, but one upshot seems clear: human reasoning does not seem to fit traditional views of human rationality. This concern about rationality has made its way through various fields and has recently caught the attention of philosophers. The concern is that if philosophers are prone to systematic errors in reasoning, then the integrity of philosophy would be threatened. In this paper, I (...) present some of the more famous work in cognitive science that has marshaled this concern. Then I present reasons to think that those with training in philosophy will be less prone to certain systematic errors in reasoning. The suggestion is that if philosophers could be shown to be less prone to such errors, then the worries about the integrity of philosophy could be constrained. Then I present evidence that, according to performance on the CRT (Frederick 2005), those who have benefited from training and selection in philosophy are indeed less prone to one kind of systematic error: irrationally arbitrating between intuitive and reflective responses. Nonetheless, philosophers are not entirely immune to this systematic error, and their proclivity for this error is statistically related to their responses to a variety of philosophical questions. So, while the evidence herein puts constraints on the worries about the integrity of philosophy, it by no means eliminates these worries. The conclusion, then, is that the present evidence offers prima facie reasons to ascribe a mitigated privilege to philosophers' ability to rationally arbitrate between intuitive and reflective responses. (shrink)