The prominence of Bayesian modeling of cognition has increased recently largely because of mathematical advances in specifying and deriving predictions from complex probabilistic models. Much of this research aims to demonstrate that cognitive behavior can be explained from rational principles alone, without recourse to psychological or neurological processes and representations. We note commonalities between this rational approach and other movements in psychology – namely, Behaviorism and evolutionary psychology – that set aside mechanistic explanations or make use of optimality assumptions. Through (...) these comparisons, we identify a number of challenges that limit the rational program's potential contribution to psychological theory. Specifically, rational Bayesian models are significantly unconstrained, both because they are uninformed by a wide range of process-level data and because their assumptions about the environment are generally not grounded in empirical measurement. The psychological implications of most Bayesian models are also unclear. Bayesian inference itself is conceptually trivial, but strong assumptions are often embedded in the hypothesis sets and the approximation algorithms used to derive model predictions, without a clear delineation between psychological commitments and implementational details. Comparing multiple Bayesian models of the same task is rare, as is the realization that many Bayesian models recapitulate existing (mechanistic level) theories. Despite the expressive power of current Bayesian models, we argue they must be developed in conjunction with mechanistic considerations to offer substantive explanations of cognition. We lay out several means for such an integration, which take into account the representations on which Bayesian inference operates, as well as the algorithms and heuristics that carry it out. We argue this unification will better facilitate lasting contributions to psychological theory, avoiding the pitfalls that have plagued previous theoretical movements. (shrink)

Jeffrey (1983) proposed a generalization of conditioning as a means of updating probability distributions when new evidence drives no event to certainty. His rule requires the stability of certain conditional probabilities through time. We tested this assumption (“invariance”) from the psychological point of view. In Experiment 1 participants offered probability estimates for events in Jeffrey’s candlelight example. Two further scenarios were investigated in Experiment 2, one in which invariance seems justified, the other in which it does not. Results were in (...) rough conformity to Jeffrey (1983)’s principle. (shrink)

Dual Process Theories of reasoning posit that judgments are mediated by both fast, automatic processes and more deliberate, analytic ones. A critical, but unanswered question concerns the issue of monitoring and control: When do reasoners rely on the first, intuitive output and when do they engage more effortful thinking? We hypothesised that initial, intuitive answers are accompanied by a metacognitive experience, called the Feeling of Rightness, which can signal when additional analysis is needed. In separate experiments, reasoners completed one of (...) four tasks: conditional reasoning, a three-term variant of conditional reasoning, problems used to measure base rate neglect, or a syllogistic reasoning task. For each task, participants were instructed to provide an initial, intuitive response to the problem along with an assessment of the rightness of that answer. They were then allowed as much time as needed to reconsider their initial answer and provide a final answer. In each experiment, we observed a robust relationship between the FOR and two measures of analytic thinking: low FOR was associated with longer rethinking times and an increased probability of answer change. In turn, FOR judgments were consistently predicted by the fluency with which the initial answer was produced, providing a link to the wider literature on metamemory. These data support a model in which a metacognitive judgment about a first, initial model determines the extent of analytic engagement. (shrink)

(2013). Why humans are (sometimes) less rational than other animals: Cognitive complexity and the axioms of rational choice. Thinking & Reasoning: Vol. 19, No. 1, pp. 1-26. doi: 10.1080/13546783.2012.713178.

Elqayam & Evans (E&E) drive a wedge between Bayesianism and instrumental rationality that most decision scientists will not recognize. Their analogy from linguistics to judgment and decision making is inapt. Normative models remain extremely useful in the progressive research programs of the judgment and decision making field.

Three experiments investigated the contrasting predictions of the evolutionary and decision-theoretic approaches to deontic reasoning. Two experiments embedded a hazard management (HM) rule in a social contract scenario that should lead to competition between innate modules. A 3rd experiment used a pure HM task. Threatening material was also introduced into the antecedent, p, of a deontic rule, if p then must q. According to the evolutionary approach, more HM responses (Cosmides & Tooby, 2000) are predicted when p is threatening, whereas (...) decision theory predicts fewer. All 3 experiments were consistent with decision theory. Other theories are discussed, and it is concluded that they cannot account for the behavior observed in these experiments. (shrink)

Oaksford & Chater (O&C) begin in the halfway Bayesian house of assuming that minor premises in conditional inferences are certain. We demonstrate that this assumption is a serious limitation. They additionally suggest that appealing to Jeffrey's rule could make their approach more general. We present evidence that this rule is not limited enough to account for actual probability judgements.

Four experiments investigated the effects of probability manipulations on the indicative four card selection task (Wason, 1966, 1968). All looked at the effects of high and low probability antecedents (p) and consequents (q) on participants' data selections when determining the truth or falsity of a conditional rule, if p then q . Experiments 1 and 2 also manipulated believability. In Experiment 1, 128 participants performed the task using rules with varied contents pretested for probability of occurrence. Probabilistic effects were observed (...) which were partly consistent with some probabilistic accounts but not with non-probabilistic approaches to selection task performance. No effects of believability were observed, a finding replicated in Experiment 2 which used 80 participants with standardised and familiar contents. Some effects in this experiment appeared inconsistent with existing probabilistic approaches. To avoid possible effects of content, Experiments 3 (48 participants) and 4 (20 participants) used abstract material. Both experiments revealed probabilistic effects. In the Discussion we examine the compatibility of these results with the various models of selection task performance. (shrink)

It has been argued that dual process theories are not consistent with Oaksford and Chater’s probabilistic approach to human reasoning (Oaksford and Chater in Psychol Rev 101:608–631, 1994 , 2007 ; Oaksford et al. 2000 ), which has been characterised as a “single-level probabilistic treatment[s]” (Evans 2007 ). In this paper, it is argued that this characterisation conflates levels of computational explanation. The probabilistic approach is a computational level theory which is consistent with theories of general cognitive architecture that invoke (...) a WM system and an LTM system. That is, it is a single function dual process theory which is consistent with dual process theories like Evans’ ( 2007 ) that use probability logic (Adams 1998 ) as an account of analytic processes. This approach contrasts with dual process theories which propose an analytic system that respects standard binary truth functional logic (Heit and Rotello in J Exp Psychol Learn 36:805–812, 2010 ; Klauer et al. in J Exp Psychol Learn 36:298–323, 2010 ; Rips in Psychol Sci 12:29–134, 2001 , 2002 ; Stanovich in Behav Brain Sci 23:645–726, 2000 , 2011 ). The problems noted for this latter approach by both Evans Psychol Bull 128:978–996, ( 2002 , 2007 ) and Oaksford and Chater (Mind Lang 6:1–38, 1991 , 1998 , 2007 ) due to the defeasibility of everyday reasoning are rehearsed. Oaksford and Chater’s ( 2010 ) dual systems implementation of their probabilistic approach is then outlined and its implications discussed. In particular, the nature of cognitive decoupling operations are discussed and a Panglossian probabilistic position developed that can explain both modal and non-modal responses and correlations with IQ in reasoning tasks. It is concluded that a single function probabilistic approach is as compatible with the evidence supporting a dual systems theory. (shrink)

This article outlines a theory of naive probability. According to the theory, individuals who are unfamiliar with the probability calculus can infer the probabilities of events in an extensional way: They construct mental models of what is true in the various possibilities. Each model represents an equiprobable alternative unless individuals have beliefs to the contrary, in which case some models will have higher probabilities than others. The probability of an event depends on the proportion of models in which it occurs. (...) The theory predicts several phenomena of reasoning about absolute probabilities, including typical biases. It correctly predicts certain cognitive illusions in inferences about relative probabilities. It accommodates reasoning based on numerical premises, and it explains how naive reasoners can infer posterior probabilities without relying on Bayes's theorem. Finally, it dispels some common misconceptions of probabilistic reasoning. (shrink)

The authors outline a theory of conditionals of the form If A then C and If A then possibly C. The 2 sorts of conditional have separate core meanings that refer to sets of possibilities. Knowledge, pragmatics, and semantics can modulate these meanings. Modulation can add information about temporal and other relations between antecedent and consequent. It can also prevent the construction of possibilities to yield 10 distinct sets of possibilities to which conditionals can refer. The mental representation of a (...) conditional normally makes explicit only the possibilities in which its antecedent is true, yielding other possibilities implicitly. Reasoners tend to focus on the explicit possibilities. The theory predicts the major phenomena of understanding and reasoning with conditionals. (shrink)

Our target article identified normativism as the view that rationality should be evaluated against unconditional normative standards. We believe this to be entrenched in the psychological study of reasoning and decision making and argued that it is damaging to this empirical area of study, calling instead for a descriptivist psychology of reasoning and decision making. The views of 29 commentators (from philosophy and cognitive science as well as psychology) were mixed, including some staunch defences of normativism, but also a number (...) that were broadly supportive of our position, although critical of various details. In particular, many defended a position that we call which sees a role for normative evaluation within boundaries alongside more descriptive research goals. In this response, we clarify our use of the term and add discussion of defining both as descriptive and non-normative concepts. We consider the debate with reference to dual-process theory, the psychology of reasoning, and empirical research strategy in these fields. We also discuss cognitive variation by age, intelligence, and culture, and the issue of relative versus absolute definitions of norms. In conclusion, we hope at least to have raised consciousness about the important boundaries between norm and description in the psychology of thinking. (shrink)

In common with a number of other authors I believe that there has been a paradigm shift in the psychology of reasoning, specifically the area traditionally labelled as the study of deduction. The deduction paradigm was founded in a philosophical tradition that assumed logicality as the basis for rational thought, and provided binary propositional logic as the agreed normative framework. By contrast, many contemporary authors assume that people have degrees of uncertainty in both premises and conclusions, and reject binary logic (...) as a workable normative system. I discuss a number of questions and challenges for this new psychology of reasoning, including the following: (a) Do we need an alternative normative system, such as Bayesianism, for the new paradigm? (b) Is there any longer a clear distinction between the study of deductive and inductive reasoning, the latter having its own tradition and literature? (c) Precisely how is the integrated study of reasoning and decision making facilitated by the new paradigm? (d) What difficulties with dual-processing approaches need to be resolved, if they are to take us forward? (shrink)

The study of deductive reasoning has been a major paradigm in psychology for approximately the past 40 years. Research has shown that people make many logical errors on such tasks and are strongly influenced by problem content and context. It is argued that this paradigm was developed in a context of logicist thinking that is now outmoded. Few reasoning researchers still believe that logic is an appropriate normative system for most human reasoning, let alone a model for describing the process (...) of human reasoning, and many use the paradigm principally to study pragmatic and probabilistic processes. It is suggested that the methods used for studying reasoning be reviewed, especially the instructional context, which necessarily defines pragmatic influences as biases. (shrink)

Normativism, the approach that judges human rationality by comparison against normative standards, has recently come under intensive criticism as unsuitable for psychological enquiry, and it has been suggested that it should be replaced with a descriptivist paradigm. My goal in this paper is to outline and defend a meta-theoretical framework of such a paradigm, grounded rationality, based on the related principles of descriptivism and (moderate) epistemic relativism. Bounded rationality takes into account universal biological and cognitive limitations on human rationality. Grounded (...) rationality accepts universal constraints but adds cognitive variability: Within-individual variability (dual processing), and individual as well as cultural differences. I discuss the implications of grounded rationality to dual processing, proposing that investing limited cognitive resources in analytic processing might be less instrumentally rational for individuals with low cognitive ability. (shrink)

In recent years, the psychology of reasoning has been undergoing a paradigm shift, with general Bayesian, probabilistic approaches replacing the older, much more restricted binary logic paradigm. At the same time, dual processing theories have been gaining influence. We argue that these developments should be integrated and moreover that such integration is already underway. The new reasoning paradigm should be grounded in dual processing for its algorithmic level of analysis just as it uses Bayesian theory for its computational level of (...) analysis. Moreover, we propose that, within the new paradigm, these levels of analysis reflect on each other. Bayesianism suggests a specific theoretical understanding of dual processing. Just as importantly, the duality in processing carries over to duality in function; although both types of processes compute degrees of belief, they generate different functions. (shrink)

We propose a critique of normativism, defined as the idea that human thinking reflects a normative system against which it should be measured and judged. We analyze the methodological problems associated with normativism, proposing that it invites the controversial “is-ought” inference, much contested in the philosophical literature. This problem is triggered when there are competing normative accounts (the arbitration problem), as empirical evidence can help arbitrate between descriptive theories, but not between normative systems. Drawing on linguistics as a model, we (...) propose that a clear distinction between normative systems and competence theories is essential, arguing that equating them invites an “is-ought” inference: to wit, supporting normative “ought” theories with empirical “is” evidence. We analyze in detail two research programmes with normativist features – Oaksford and Chater’s rational analysis and Stanovich and West’s individual differences approach – demonstrating how, in each case, equating norm and competence leads to an is-ought inference. Normativism triggers a host of research biases in the psychology of reasoning and decision making: focusing on untrained participants and novel problems, analyzing psychological processes in terms of their normative correlates, and neglecting philosophically significant paradigms when they do not supply clear standards for normative judgement. For example, in a dual-process framework, normativism can lead to a fallacious “ought-is” inference, in which normative responses are taken as diagnostic of analytic reasoning. We propose that little can be gained from normativism that cannot be achieved by descriptivist computational-level analysis, illustrating our position with Hypothetical Thinking Theory and the theory of the suppositional conditional. We conclude that descriptivism is a viable option, and that theories of higher mental processing would be better off freed from normative considerations. (shrink)

Norms—that is, specifications of what we ought to do—play a critical role in the study of informal argumentation, as they do in studies of judgment, decision-making and reasoning more generally. Specifically, they guide a recurring theme: are people rational? Though rules and standards have been central to the study of reasoning, and behavior more generally, there has been little discussion within psychology about why (or indeed if) they should be considered normative despite the considerable philosophical literature that bears on this (...) topic. In the current paper, we ask what makes something a norm, with consideration both of norms in general and a specific example: norms for informal argumentation. We conclude that it is both possible and desirable to invoke norms for rational argument, and that a Bayesian approach provides solid normative principles with which to do so. (shrink)

Three experiments are reported which show that in certain contexts subjects reject instances of the valid modus ponens and modus tollens inference form in conditional arguments. For example, when a conditional premise, such as: If she meets her friend then she will go to a play, is accompanied by a conditional containing an additional requirement: If she has enough money then she will go to a play, subjects reject the inference from the categorical premise: She meets her friend, to the (...) conclusion: She will go to a play. Other contexts suppress the conditional fallacies. The first experiment demonstrates the effects of context on conditional reasoning. The second experiment shows that the inference suppression disappears when the categorical premise refers to both of the antecedents, such as: She meets her friend and she has enough money. In this case, subjects make both the valid inferences and the fallacies, regardless of the contextual information. The third experiment establishes that when subjects are given general information about the duration of a situation in which a conditional inducement was uttered, such as: If you shout then I will shoot you, they reject both the valid inferences and the fallacies. The results suggest that the interpretation of premises plays an even more central role in reasoning than has previously been admitted. Trois expériences montrent que dans certains contextes les sujets rejettent des instances valides de modus ponens et de modus tollens dans des énoncés conditionnels. Par exemple, quand une prémisse conditionnelle comme: Si elle rencontre son ami, alors elle ira jouer, est accompagnée par une phrase contenant une condition supplémentaire: Si elle a assez d'argent, alors elle ira jouer, les sujets rejettent l'inférence liant la prémisse catégorielle: Elle rencontre son ami, à la conclusion: Elle ira jouer. D'autres contextes éliminent également les inférences conditionnelles fallacieuses. La premiére expérience démontre l'effet du contexte sur la raisonnement conditionnel. La deuxiéme expérience montre que la suppression de l'inférence disparait quand la prémisse catégorielle fait référence aux deux antécédants, comme: Elle rencontre son ami et elle a assez d'argent. Dans ce cas, les sujets font aussi bien les inférences valides et fallacieuses, quelle que soit l'information contextuelle. La troisiéme expérience établit que quand l'on donne aux sujets des informations générales à propos de la durée d'une situation dans laquelle une conditionnelle a été prononcée, comme Si tu cries, alors je te tire dessus, ils rejettent autant les inférences valides que les inférences fallacieuses. Ces résultats suggèrent que l'interprétation des prémisses joue un rŏle encore plus central dans le raisonnement que l'on admettait auparavant. (shrink)

The commentaries indicate a general agreement that one source of reduction of base-rate neglect involves making structural relations among relevant sets transparent. There is much less agreement, however, that this entails dual systems of reasoning. In this response, we make the case for our perspective on dual systems. We compare and contrast our view to the natural frequency hypothesis as formulated in the commentaries.