Suppose that two competing norms, N1 and N2, can be identified such that a given person’s response can be interpreted as correct according to N1 but incorrect according to N2. Which of these two norms, if any, should one use to interpret such a response? In this paper we seek to address this fundamental problem by studying individual variation in the interpretation of conditionals by establishing individual profiles of the participants based on their case judgments and reflective attitudes. To investigate (...) the participants’ reflective attitudes we introduce a new experimental paradigm called the Scorekeeping Task. As a case study, we identify the participants who follow the Suppositional Theory of conditionals (N1) versus Inferentialism (N2) and investigate to what extent internally consistent competence models can be reconstructed for the participants on this basis. After extensive empirical investigations, an apparent reasoning error with and-to-if inferences was found in one of these two groups. The implications of this case study for debates on the proper role of normative considerations in psychology are discussed. (shrink)

In this paper, new evidence is presented for the assumption that the reason-relation reading of indicative conditionals ('if A, then C') reflects a conventional implicature. In four experiments, it is investigated whether relevance effects found for the probability assessment of indicative conditionals (Skovgaard-Olsen, Singmann, and Klauer, 2016a) can be classified as being produced by a) a conversational implicature, b) a (probabilistic) presupposition failure, or c) a conventional implicature. After considering several alternative hypotheses and the accumulating evidence from other studies as (...) well, we conclude that the evidence is most consistent with the Relevance Effect being the outcome of a conventional implicature. This finding indicates that the reason-relation reading is part of the semantic content of indicative conditionals, albeit not part of their primary truth-conditional content. (shrink)

The paper introduces, compares and contrasts formal models of source reliability proposed in the epistemology literature, in particular the prominent models of Bovens and Hartmann and Olsson :127–143, 2011). All are Bayesian models seeking to provide normative guidance, yet they differ subtly in assumptions and resulting behavior. Models are evaluated both on conceptual grounds and through simulations, and the relationship between models is clarified. The simulations both show surprising similarities and highlight relevant differences between these models. Most importantly, however, our (...) evaluations reveal that important normative concerns arguably remain unresolved. The philosophical implications of this for testimony are discussed. (shrink)

The appeal to expert opinion is an argument form that uses the verdict of an expert to support a position or hypothesis. A previous scheme-based treatment of the argument form is formalized within a Bayesian network that is able to capture the critical aspects of the argument form, including the central considerations of the expert's expertise and trustworthiness. We propose this as an appropriate normative framework for the argument form, enabling the development and testing of quantitative predictions as to how (...) people evaluate this argument, suggesting that such an approach might be beneficial to argumentation research generally. We subsequently present two experiments as an example of the potential for future research in this vein, demonstrating that participants' quantitative ratings of the convincingness of a proposition that has been supported with an appeal to expert opinion were broadly consistent with the predictions of the Bayesian model. (shrink)

In this paper, it is argued that the most fruitful approach to developing normative models of argument quality is one that combines the argumentation scheme approach with Bayesian argumentation. Three sample argumentation schemes from the literature are discussed: the argument from sign, the argument from expert opinion, and the appeal to popular opinion. Limitations of the scheme-based treatment of these argument forms are identified and it is shown how a Bayesian perspective may help to overcome these. At the same time, (...) the contributions of the standard scheme-based approach are highlighted, and it is argued that only a combination of the insights of different traditions will yield a complete normative theory of argument quality. (shrink)

Our beliefs and opinions are shaped by others, making our social networks crucial in determining what we believe to be true. Sometimes this is for the good because our peers help us form a more accurate opinion. Sometimes it is for the worse because we are led astray. In this context, we address via agent-based computer simulations the extent to which patterns of connectivity within our social networks affect the likelihood that initially undecided agents in a network converge on a (...) true opinion following group deliberation. The model incorporates a fine-grained and realistic representation of belief and trust, and it allows agents to consult outside information sources. We study a wide range of network structures and provide a detailed statistical analysis concerning the exact contribution of various network metrics to collective competence. Our results highlight and explain the collective risks involved in an overly networked or partitioned society. Specifically, we find that 96% of the variation in collective competence across networks can be attributed to differences in amount of connectivity and clustering, which are negatively correlated with collective competence. A study of bandwagon or “group think” effects indicates that both connectivity and clustering increase the probability that the network, wholly or partly, locks into a false opinion. Our work is interestingly related to Gerhard Schurz’s work on meta-induction and can be seen as broadly addressing a practical limitation of his approach. (shrink)

Argumentation is pervasive in everyday life. Understanding what makes a strong argument is therefore of both theoretical and practical interest. One factor that seems intuitively important to the strength of an argument is the reliability of the source providing it. Whilst traditional approaches to argument evaluation are silent on this issue, the Bayesian approach to argumentation (Hahn & Oaksford, 2007) is able to capture important aspects of source reliability. In particular, the Bayesian approach predicts that argument content and source reliability (...) should interact to determine argument strength. In this paper, we outline the approach and then demonstrate the importance of source reliability in two empirical studies. These experiments show the multiplicative relationship between the content and the source of the argument predicted by the Bayesian framework. (shrink)

In recent years, the receipt and the perception of information has changed in ways which have fueled fears about the fates of our democracies. However, real information on these possibilities or the direction of these changes does not exist. Into this gap, Hahn and colleagues bring the power of Condorcet's (1785) Jury Theorem to show that changes in our information networks have affected voter inter‐dependence so that it is likely that voters are now collectively more ignorant even if individual voter (...) competence remains unchanged. (shrink)

We examine in detail three classic reasoning fallacies, that is, supposedly ``incorrect'' forms of argument. These are the so-called argumentam ad ignorantiam, the circular argument or petitio principii, and the slippery slope argument. In each case, the argument type is shown to match structurally arguments which are widely accepted. This suggests that it is not the form of the arguments as such that is problematic but rather something about the content of those examples with which they are typically justified. This (...) leads to a Bayesian reanalysis of these classic argument forms and a reformulation of the conditions under which they do or do not constitute legitimate forms of argumentation. (shrink)

Norms—that is, specifications of what we ought to do—play a critical role in the study of informal argumentation, as they do in studies of judgment, decision-making and reasoning more generally. Specifically, they guide a recurring theme: are people rational? Though rules and standards have been central to the study of reasoning, and behavior more generally, there has been little discussion within psychology about why (or indeed if) they should be considered normative despite the considerable philosophical literature that bears on this (...) topic. In the current paper, we ask what makes something a norm, with consideration both of norms in general and a specific example: norms for informal argumentation. We conclude that it is both possible and desirable to invoke norms for rational argument, and that a Bayesian approach provides solid normative principles with which to do so. (shrink)

This paper examines the basic question of how we can come to form accurate beliefs about the world when we do not fully know how good or bad our evidence is. Here, we show, using simulations with otherwise optimal agents, the cost of misjudging the quality of our evidence. We compare different strategies for correctly estimating that quality, such as outcome‐ and expectation‐based updating. We also identify conditions under which misjudgment of evidence quality can nevertheless lead to accurate beliefs, as (...) well as those conditions where no strategy will help. These results indicate both where people will nevertheless succeed and where they will fail when information quality is degraded. (shrink)

Conditionals and conditional reasoning have been a long-standing focus of research across a number of disciplines, ranging from psychology through linguistics to philosophy. But almost no work has concerned itself with the question of how hearing or reading a conditional changes our beliefs. Given that we acquire much—perhaps most—of what we believe through the testimony of others, the simple matter of acquiring conditionals via others’ assertion of a conditional seems integral to any full understanding of the conditional and conditional reasoning. (...) In this paper we detail a number of basic intuitions about how beliefs might change in response to a conditional being uttered, and show how these are backed by behavioral data. In the remainder of the paper, we then show how these deceptively simple phenomena pose a fundamental challenge to present theoretical accounts of the conditional and conditional reasoning – a challenge which no account presently fully meets. (shrink)

The notion of “the burden of proof” plays an important role in real-world argumentation contexts, in particular in law. It has also been given a central role in normative accounts of argumentation, and has been used to explain a range of classic argumentation fallacies. We argue that in law the goal is to make practical decisions whereas in critical discussion the goal is frequently simply to increase or decrease degree of belief in a proposition. In the latter case, it is (...) not necessarily important whether that degree of belief exceeds a particular threshold (e.g., ‘reasonable doubt’). We explore the consequences of this distinction for the role that the “burden of proof” has played in argumentation and in theories of fallacy. (shrink)

Reasoning with conditionals is central to everyday life, yet there is long-standing disagreement about the meaning of the conditional. One example is the puzzle of so-called missing-link conditionals such as "if raccoons have no wings, they cannot breathe under water." Their oddity may be taken to show that conditionals require a connection between antecedent ("raccoons have no wings") and consequent ("they cannot breathe under water"), yet most accounts of conditionals attribute the oddity to natural language pragmatics. We present an experimental (...) study disentangling the pragmatic requirement of discourse coherence from a stronger notion of connection: probabilistic relevance. Results indicate that mere discourse coherence is not enough to make conditionals assertable. (shrink)

Possible measures to mitigate climate change require global collective actions whose impacts will be felt by many, if not all. Implementing such actions requires successful communication of the reasons for them, and hence the underlying climate science, to a degree that far exceeds typical scientific issues which do not require large-scale societal response. Empirical studies have identified factors, such as the perceived level of consensus in scientific opinion and the perceived reliability of scientists, that can limit people's trust in science (...) communicators and their subsequent acceptance of climate change claims. Little consideration has been given, however, to recent formal results within philosophy concerning the relationship between truth, the reliability of evidence sources, the coherence of multiple pieces of evidence/testimonies, and the impact of independence between sources of evidence. This study draws on these results to evaluate exactly what has been established in the empirical literature about the factors that bias the public's reception of scientific communications about climate change. (shrink)

There has been much interest in group judgment and the so-called 'wisdom of crowds'. In many real world contexts, members of groups not only share a dependence on external sources of information, but they also communicate with one another, thus introducing correlations among their responses that can diminish collective accuracy. This has long been known, but it has-to date-not been examined to what extent different kinds of communication networks may give rise to systematically different effects on accuracy. We argue that (...) equations that relate group accuracy, individual accuracy, and group diversity are useful theoretical tools for understanding group performance in the context of research on group structure. In particular, these equations may serve to identify the kind of group structures that improve individual accuracy without thereby excessively diminishing diversity so that the net positive effect is an improvement even on the level of collective accuracy. Two experiments are reported where two structures are investigated from this perspective. It is demonstrated that the more constrained network outperforms the network with a free flow of information. (shrink)

Information generally comes from less than fully reliable sources. Rationality, it seems, requires that one take source reliability into account when reasoning on the basis of such information. Recently, Bovens and Hartmann (2003) proposed an account of the conjunction fallacy based on this idea. They show that, when statements in conjunction fallacy scenarios are perceived as coming from such sources, probability theory prescribes that the “fallacy” be committed in certain situations. Here, the empirical validity of their model was assessed. The (...) model predicts that statements added to standard conjunction problems will change the incidence of the fallacy. It also predicts that statements from reliable sources should yield an increase in fallacy rates (relative to unreliable sources). Neither the former (Experiment 1) nor the latter prediction (Experiment 3) was confirmed, although Experiment 2 showed that people can derive source reliability estimates from the likelihood of statements in a manner consistent with the tested model. In line with the experimental results, model fits and sensitivity analyses also provided very little evidence in favor of the model. This suggests that Bovens and Hartmann’s present model fails to explain fully people’s judgements in standard conjunction fallacy tasks. (shrink)

Much of what we believe we know, we know through the testimony of others. While there has been long-standing evidence that people are sensitive to the characteristics of the sources of testimony, for example in the context of persuasion, researchers have only recently begun to explore the wider implications of source reliability considerations for the nature of our beliefs. Likewise, much remains to be established concerning what factors influence source reliability. In this paper, we examine, both theoretically and empirically, the (...) implications of using message content as a cue to source reliability. We present a set of experiments examining the relationship between source information and message content in people's responses to simple communications. The results show that people spontaneously revise their beliefs in the reliability of the source on the basis of the expectedness of a source's claim and, conversely, adjust message impact by perceived reliability; hence source reliability and message content have a bi-directional relationship. The implications are discussed for a variety of psychological, philosophical and political issues such as belief polarization and dual-route models of persuasion. (shrink)

In this article, we argue for the general importance of normative theories of argument strength. We also provide some evidence based on our recent work on the fallacies as to why Bayesian probability might, in fact, be able to supply such an account. In the remainder of the article we discuss the general characteristics that make a specifically Bayesian approach desirable, and critically evaluate putative flaws of Bayesian probability that have been raised in the argumentation literature.

Topics in Cognitive Science, Volume 14, Issue 3, Page 602-620, July 2022.

Although argumentation plays an essential role in our lives, there is no integrated area of research on the psychology of argumentation. Instead research on argumentation is conducted in a number of separate research communities that are spread across disciplines and have only limited interaction. With a view to bridging these different strands, we first distinguish between three meanings of the word ?argument?: argument as a reason, argument as a structured sequence of reasons and claims, and argument as a social exchange. (...) All three meanings are integral to a complete understanding of human reasoning and cognition. Cognitive psychological research on argumentation has focused mostly on the first and second of these meanings, so we present perspectives on argumentation from outside of cognitive psychology, which focus on the second and third. Specifically, we give anoverview of the methods, goals, and disciplinary backgrounds of research on the production, the analysis, and the evaluation of arguments. Finally, inintroducing the experimental studies included in this special issue, which were conducted by researchers from a range of theoretical backgrounds, weunderline the breadth of argumentation research as well as stress opportunities for mutual awareness and integration. (shrink)

In this chapter, we outline the range of argument forms involving causation that can be found in everyday discourse. We also survey empirical work concerned with the generation and evaluation of such arguments. This survey makes clear that there is presently no unified body of research concerned with causal argument. We highlight the benefits of a unified treatment both for those interested in causal cognition and those interested in argumentation, and identify the key challenges that must be met for a (...) full understanding of causal argumentation. (shrink)

This paper explores ‘reasonable doubt’ as an enlightening notion to think of reasoning and decision-making generally, beyond the judicial domain. The paper starts from a decision-theoretic understanding of the notion, whereby it can be defined in terms of degrees of belief and a probabilistic confirmation threshold for action. It then highlights some of the limits of this notion, and proposes a richer analysis of epistemic states and reasoning through the lens of ‘reasonable doubt’, which in turn is likely to supplement (...) the DT framework. The strategy consists in fighting on two fronts: with DT, the paper claims that there is no absolute notion of ‘reasonable doubt’ but, pace DT, it shows that reasonable doubt cannot be accounted for only in terms of degrees of belief and probabilistic threshold. We argue that the lens of reasonable doubt sheds light on aspects of belief dynamics, as well as of the nature of epistemic attitudes, which are often obscured by belief-centred approaches. In particular, when it comes to acknowledging the necessary ignorance and irreducible uncertainty that we face in our everyday-life decisions, studying the various facets of doubt rather than focusing on what can be believed, enables one to do justice to the richness and diversity of the mental states in play. (shrink)

(2013). Rational argument, rational inference. Argument & Computation: Vol. 4, Formal Models of Reasoning in Cognitive Psychology, pp. 21-35. doi: 10.1080/19462166.2012.689327.

One of the most striking features of is the detail with which behavior on logical reasoning tasks can now be predicted and explained. This detail is surprising, given the state of the field 10 to 15 years ago, and it has been brought about by a theoretical program that largely ignores consideration of cognitive processes, that is, any kind of internal behavior that generates overt responding. It seems that an increase in explanatory power can be achieved by restricting a psychological (...) theory. (shrink)

The statistics of small samples are often quite different from those of large samples, and this needs to be taken into account in assessing the rationality of human behavior. Specifically, in evaluating human responses to environmental statistics, it is the effective environment that matters; that is, the environment actually experienced by the agent needs to be considered, not simply long‐run frequencies. Significant deviations from long‐run statistics may arise through experiential limitations of the agent that stem from resource constraints and/or information‐processing (...) bounds. The article draws together recent work from a number of areas in judgment and decision making ranging from randomness perception (Hahn & Warren, ), information sampling (Hertwig & Pleskac, ; Kareev et al., ), and consequences of choice for exploration or exploitation (e.g., Denrell, ) to demonstrate how proper consideration of these deviations leads to reevaluation of behaviors that are otherwise deemed irrational. (shrink)

Conditionals pervade every aspect of our thinking, from the mundane and everyday such as ‘if you eat too much cheese, you will have nightmares’ to the most fundamental concerns as in ‘if global warming isn’t halted, sea levels will rise dramatically’. Many decades of research have focussed on the semantics of conditionals and how people reason from conditionals in everyday life. Here it has been rather overlooked how we come to such conditionals in the first place. In many cases, they (...) are learned through testimony: someone warns us about the ill-effects of cheese. Any full account of the conditional must consequently incorporate such learning. Here, we provide a new formal account of belief change in response to a testimonial conditional. (shrink)

A large body of work has demonstrated the utility of the Bayesian framework for capturing inference in both specialist and everyday contexts. However, the central tool of the framework, conditionalization via Bayes’ rule, does not apply directly to a common type of learning: the acquisition of conditional information. How should an agent change her beliefs on learning that “If A, then C”? This issue, which is central to both reasoning and argumentation, has recently prompted considerable research interest. In this paper, (...) we critique a prominent proposal and provide a new, alternative, answer. -/- . (shrink)

Informatics and the Foundations of Legal Reasoning represents a close collaboration between a wide range of disciplines and countries. Fourteen papers, together with a long analytical introduction by the editors, were selected from the contributions of legal theorists, computer scientists, philosophers and logicians who were members of an International Working Group supported by the European Commission. The Group was mandated to work towards determining how far the law is amenable to formal modeling, and in what ways computers might assist legal (...) thinking and practice. The book is the result of discussions held by the Group over two and half years. It will help students and researchers from different backgrounds to focus on a common set of topics of increasing general interest. It embodies the results of work in progress and suggests many issues for further discussion. A stimulating text for undergraduate and graduate courses in law, philosophy and computer science departments, as well as for those interested in the place of computers in legal practice, especially at the international level. (shrink)

Concepts allow us to treat different objects equivalently according to shared attributes, and hence to communicate about, draw inferences from, reason with, and explain these objects. Understanding how concepts are formed and used is thus essential to understanding and applying these basic processes, and the topic of similarity-based classification is central to psychology, artificial intelligence, statistics, and philosophy. This book brings together leading researchers, reflecting the key topics and important developments in the field and provides a uniquely interdisciplinary overview of (...) the subject. (shrink)

A longstanding question is the extent to which "reasonable doubt" may be expressed simply in terms of a threshold degree of belief. In this context, we examine the extent to which learning about possible alternatives may alter one's beliefs about a target hypothesis, even when no new "evidence" linking them to the hypothesis is acquired. Imagine the following scenario: a crime has been committed and Alice, the police's main suspect has been brought to trial. There are several pieces of evidence (...) that raise the probability that Alice committed the crime. Her attorney's defense strategy is not to challenge this evidence, but instead to provide personal details about Alice's neighbour, Jane. While Jane is one of many people the police spoke to, they saw no reason to investigate her further. You now learn that Jane, too, had access to the shed where the murder weapon was stored, just like Alice. To what extent should this alter your beliefs about Alice's guilt? In this paper, we provide a formal description of the problem and a solution indicating circumstances under which learning about Jane will more or less impact beliefs about Alice. (shrink)

In a recent article in Argumentation, O’Keefe (Argumentation 21:151–163, 2007) observed that the well-known ‘framing effects’ in the social psychological literature on persuasion are akin to traditional fallacies of argumentation and reasoning and could be exploited for persuasive success in a way that conflicts with principles of responsible advocacy. Positively framed messages (“if you take aspirin, your heart will be more healthy”) differ in persuasive effect from negative frames (“if you do not take aspirin, your heart will be less healthy”), (...) despite containing ‘equivalent’ content. This poses a potential problem, because people might be unduly (and unsuspectingly) influenced by mere presentational differences. By drawing on recent cognitive psychological work on framing effects in choice and decision making paradigms, however, we show that establishing whether two arguments are substantively equivalent—and hence, whether there is any normative requirement for them to be equally persuasive—is a difficult task. Even arguments that are logically equivalent may not be information equivalent. The normative implications of this for both speakers and listeners are discussed. (shrink)