Probabilistic models have much to offer to philosophy. We continually receive information from a variety of sources: from our senses, from witnesses, from scientific instruments. When considering whether we should believe this information, we assess whether the sources are independent, how reliable they are, and how plausible and coherent the information is. Bovens and Hartmann provide a systematic Bayesian account of these features of reasoning. Simple Bayesian Networks allow us to model alternative assumptions about the nature of the information sources. (...) Measurement of the coherence of information is a controversial matter: arguably, the more coherent a set of information is, the more confident we may be that its content is true, other things being equal. The authors offer a new treatment of coherence which respects this claim and shows its relevance to scientific theory choice. Bovens and Hartmann apply this methodology to a wide range of much discussed issues regarding evidence, testimony, scientific theories, and voting. Bayesian Epistemology is an essential tool for anyone working on probabilistic methods in philosophy, and has broad implications for many other disciplines. (shrink)

A glance at the sky raises my probability of rain to .7. As it happens, the conditional probabilities of each state given rain remain the same, and similarly for their conditional probabilities given no rain. As Jeffrey (1983, Ch. 11) points out, my new distribution P2 is therefore fixed by the law of total probability. For example, P2(RC) = P2(RC | R)P2(R)+P2(RC | ¯.

This paper approaches the problem of testimony from a new direction. Rather than focusing on the epistemic grounds for testimony, it considers the problem from the perspective of an individual who must choose whom to trust from a population of many would-be testifiers. A computer simulation is presented which illustrates that in many plausible situations, those who trust without attempting to judge the reliability of testifiers outperform those who attempt to seek out the more reliable members of the community. In (...) so doing, it presents a novel defense for the credulist position that argues one should trust testimony without considering the underlying reliability of the testifier. (shrink)

Epistemic trust is crucial for science. This article aims to identify the kinds of assumptions that are involved in epistemic trust as it is required for the successful operation of science as a collective epistemic enterprise. The relevant kind of reliance should involve working from the assumption that the epistemic endeavors of others are appropriately geared towards the truth, but the exact content of this assumption is more difficult to analyze than it might appear. The root of the problem is (...) that methodological decisions in science typically involve a complex trade-off between the reliability of positive results, the reliability of negative results, and the investigation's power. Which balance between these is the ‘correct’ one can only be determined in light of an evaluation of the consequences of all the different possible outcomes of the inquiry. What it means for the investigation to be ‘appropriately geared towards the truth’ thus depends on certain value judgments. I conclude that in the optimal case, trusting someone in her capacity as an information provider also involves a reliance on her having the right attitude towards the possible consequences of her epistemic work. 1 Introduction2 Epistemic Reliance within the Sciences3 Methodological Conventionalism4 Trust in Science5 Conclusions. (shrink)

The paper presents and defends a Bayesian theory of trust in social networks. In the first part of the paper, we provide justifications for the basic assumptions behind the model, and we give reasons for thinking that the model has plausible consequences for certain kinds of communication. In the second part of the paper we investigate the phenomenon of overconfidence. Many psychological studies have found that people think they are more reliable than they actually are. Using a simulation environment that (...) has been developed in order to make our model computationally tractable we show that in our model inquirers are indeed sometimes better off from an epistemic perspective overestimating the reliability of their own inquiries. We also show, by contrast, that people are rarely better off overestimating the reliability of others. On the basis of these observations we formulate a novel hypothesis about the value of overconfidence. (shrink)

In a seminal book, Alvin I. Goldman outlines a theory for how to evaluate social practices with respect to their “veritistic value”, i.e., their tendency to promote the acquisition of true beliefs in society. In the same work, Goldman raises a number of serious worries for his account. Two of them concern the possibility of determining the veritistic value of a practice in a concrete case because we often don't know what beliefs are actually true, and even if we did, (...) the task of determining the veritistic value would be computationally extremely difficult. Neither problem is specific to Goldman's theory and both can be expected to arise for just about any account of veritistic value. It is argued here that the first problem does not pose a serious threat to large classes of interesting practices. The bulk of the paper is devoted to the computational problem, which, it is submitted, can be addressed in promising terms by means of computer simulation. In an attempt to add vividness to this proposal, an up-and-running simulation environment is presented and put to some preliminary tests. (shrink)

Epistemologists can be divided into two camps: those who think that nothing short of certainty or (subjective) probability 1 can warrant assertion and those who disagree with this claim. This paper addressed this issue by inquiring into the problem of setting the probability threshold required for assertion in such a way that that the social epistemic good is maximized, where the latter is taken to be the veritistic value in the sense of Goldman (Knowledge in a social world, 1999). We (...) provide a Bayesian model of a test case involving a community of inquirers in a social network engaged in group deliberation regarding the truth or falsity of a proposition $p.$ p . Results obtained by means of computer simulation indicate that the certainty rule is optimal in the limit of inquiry and communication but that a lower threshold is preferable in less idealized cases. (shrink)

In a seminal book, Alvin I. Goldman outlines a theory for how to evaluate social practices with respect to their , i.e., their tendency to promote the acquisition of true beliefs (and impede the acquisition of false beliefs) in society. In the same work, Goldman raises a number of serious worries for his account. Two of them concern the possibility of determining the veritistic value of a practice in a concrete case because (1) we often don't know what beliefs are (...) actually true, and (2) even if we did, the task of determining the veritistic value would be computationally extremely difficult. Neither problem is specific to Goldman's theory and both can be expected to arise for just about any account of veritistic value. It is argued here that the first problem does not pose a serious threat to large classes of interesting practices. The bulk of the paper is devoted to the computational problem, which, it is submitted, can be addressed in promising terms by means of computer simulation. In an attempt to add vividness to this proposal, an up-and-running simulation environment (Laputa) is presented and put to some preliminary tests. (shrink)

One of the fundamental problems of epistemology is to say when the evidence in an agent’s possession justifies the beliefs she holds. In this paper and its prequel, we defend the Bayesian solution to this problem by appealing to the following fundamental norm: Accuracy An epistemic agent ought to minimize the inaccuracy of her partial beliefs. In the prequel, we made this norm mathematically precise; in this paper, we derive its consequences. We show that the two core tenets of Bayesianism (...) follow from the norm, while the characteristic claim of the Objectivist Bayesian follows from the norm along with an extra assumption. Finally, we consider Richard Jeffrey’s proposed generalization of conditionalization. We show not only that his rule cannot be derived from the norm, unless the requirement of Rigidity is imposed from the start, but further that the norm reveals it to be illegitimate. We end by deriving an alternative updating rule for those cases in which Jeffrey’s is usually supposed to apply. (shrink)

Information generally comes from less than fully reliable sources. Rationality, it seems, requires that one take source reliability into account when reasoning on the basis of such information. Recently, Bovens and Hartmann (2003) proposed an account of the conjunction fallacy based on this idea. They show that, when statements in conjunction fallacy scenarios are perceived as coming from such sources, probability theory prescribes that the “fallacy” be committed in certain situations. Here, the empirical validity of their model was assessed. The (...) model predicts that statements added to standard conjunction problems will change the incidence of the fallacy. It also predicts that statements from reliable sources should yield an increase in fallacy rates (relative to unreliable sources). Neither the former (Experiment 1) nor the latter prediction (Experiment 3) was confirmed, although Experiment 2 showed that people can derive source reliability estimates from the likelihood of statements in a manner consistent with the tested model. In line with the experimental results, model fits and sensitivity analyses also provided very little evidence in favor of the model. This suggests that Bovens and Hartmann’s present model fails to explain fully people’s judgements in standard conjunction fallacy tasks. (shrink)

The appeal to expert opinion is an argument form that uses the verdict of an expert to support a position or hypothesis. A previous scheme-based treatment of the argument form is formalized within a Bayesian network that is able to capture the critical aspects of the argument form, including the central considerations of the expert's expertise and trustworthiness. We propose this as an appropriate normative framework for the argument form, enabling the development and testing of quantitative predictions as to how (...) people evaluate this argument, suggesting that such an approach might be beneficial to argumentation research generally. We subsequently present two experiments as an example of the potential for future research in this vein, demonstrating that participants' quantitative ratings of the convincingness of a proposition that has been supported with an appeal to expert opinion were broadly consistent with the predictions of the Bayesian model. (shrink)

Bayesian probability has recently been proposed as a normative theory of argumentation. In this article, we provide a Bayesian formalisation of the ad Hitlerum argument, as a special case of the ad hominem argument. Across three experiments, we demonstrate that people's evaluation of the argument is sensitive to probabilistic factors deemed relevant on a Bayesian formalisation. Moreover, we provide the first parameter-free quantitative evidence in favour of the Bayesian approach to argumentation. Quantitative Bayesian prescriptions were derived from participants' stated subjective (...) probabilities (Experiments 1 and 2), as well as from frequency information explicitly provided in the experiment (Experiment 3). Participants' stated evaluations of the convincingness of the argument were well matched to these prescriptions. (shrink)

Our beliefs and opinions are shaped by others, making our social networks crucial in determining what we believe to be true. Sometimes this is for the good because our peers help us form a more accurate opinion. Sometimes it is for the worse because we are led astray. In this context, we address via agent-based computer simulations the extent to which patterns of connectivity within our social networks affect the likelihood that initially undecided agents in a network converge on a (...) true opinion following group deliberation. The model incorporates a fine-grained and realistic representation of belief and trust, and it allows agents to consult outside information sources. We study a wide range of network structures and provide a detailed statistical analysis concerning the exact contribution of various network metrics to collective competence. Our results highlight and explain the collective risks involved in an overly networked or partitioned society. Specifically, we find that 96% of the variation in collective competence across networks can be attributed to differences in amount of connectivity and clustering, which are negatively correlated with collective competence. A study of bandwagon or “group think” effects indicates that both connectivity and clustering increase the probability that the network, wholly or partly, locks into a false opinion. Our work is interestingly related to Gerhard Schurz’s work on meta-induction and can be seen as broadly addressing a practical limitation of his approach. (shrink)

In recent years, the receipt and the perception of information has changed in ways which have fueled fears about the fates of our democracies. However, real information on these possibilities or the direction of these changes does not exist. Into this gap, Hahn and colleagues bring the power of Condorcet's (1785) Jury Theorem to show that changes in our information networks have affected voter inter‐dependence so that it is likely that voters are now collectively more ignorant even if individual voter (...) competence remains unchanged. (shrink)

This paper examines the basic question of how we can come to form accurate beliefs about the world when we do not fully know how good or bad our evidence is. Here, we show, using simulations with otherwise optimal agents, the cost of misjudging the quality of our evidence. We compare different strategies for correctly estimating that quality, such as outcome‐ and expectation‐based updating. We also identify conditions under which misjudgment of evidence quality can nevertheless lead to accurate beliefs, as (...) well as those conditions where no strategy will help. These results indicate both where people will nevertheless succeed and where they will fail when information quality is degraded. (shrink)

Argumentation is pervasive in everyday life. Understanding what makes a strong argument is therefore of both theoretical and practical interest. One factor that seems intuitively important to the strength of an argument is the reliability of the source providing it. Whilst traditional approaches to argument evaluation are silent on this issue, the Bayesian approach to argumentation (Hahn & Oaksford, 2007) is able to capture important aspects of source reliability. In particular, the Bayesian approach predicts that argument content and source reliability (...) should interact to determine argument strength. In this paper, we outline the approach and then demonstrate the importance of source reliability in two empirical studies. These experiments show the multiplicative relationship between the content and the source of the argument predicted by the Bayesian framework. (shrink)

Mainstream epistemology is a highly theoretical and abstract enterprise. Traditional epistemologists rarely present their deliberations as critical to the practical problems of life, unless one supposes—as Hume, for example, did not—that skeptical worries should trouble us in our everyday affairs. But some issues in epistemology are both theoretically interesting and practically quite pressing. That holds of the problem to be discussed here: how laypersons should evaluate the testimony of experts and decide which of two or more rival experts is most (...) credible. It is of practical importance because in a complex, highly specialized world people are constantly confronted with situations in which, as comparative novices, they must turn to putative experts for intellectual guidance or assistance. It is of theoretical interest because the appropriate epistemic considerations are far from transparent; and it is not clear how far the problems lead to insurmountable skeptical quandaries. This paper does not argue for flat-out skepticism in this domain; nor, on the other hand, does it purport to resolve all pressures in the direction of skepticism. It is an exploratory paper, which tries to identify problems and examine some possible solutions, not to establish those solutions definitively. (shrink)

A Bayesian network (BN) is a graphical model of uncertainty that is especially well suited to legal arguments. It enables us to visualize and model dependencies between different hypotheses and pieces of evidence and to calculate the revised probability beliefs about all uncertain factors when any piece of new evidence is presented. Although BNs have been widely discussed and recently used in the context of legal arguments, there is no systematic, repeatable method for modeling legal arguments as BNs. Hence, where (...) BNs have been used in the legal context, they are presented as completed pieces of work, with no insights into the reasoning and working that must have gone into their construction. This means the process of building BNs for legal arguments is ad hoc, with little possibility for learning and process improvement. This article directly addresses this problem by describing a method for building useful legal arguments in a consistent and repeatable way. The method complements and extends recent work by Hepler, Dawid, and Leucari (2007) on object-oriented BNs for complex legal arguments and is based on the recognition that such arguments can be built up from a small number of basic causal structures (referred to as idioms). We present a number of examples that demonstrate the practicality and usefulness of the method. (shrink)

How should you take into account the opinions of an advisor? When you completely defer to the advisor's judgment, then you should treat the advisor as a guru. Roughly, that means you should believe what you expect she would believe, if supplied with your extra evidence. When the advisor is your own future self, the resulting principle amounts to a version of the Reflection Principle---a version amended to handle cases of information loss. When you count an advisor as an epistemic (...) peer, you should give her conclusions the same weight as your own. Denying that view---call it the ``equal weight view''---leads to absurdity: the absurdity that you could reasonably come to believe yourself to be an epistemic superior to an advisor simply by noting cases of disagreement with her, and taking it that she made most of the mistakes. Accepting the view seems to lead to another absurdity: that one should suspend judgment about everything that one's smart and well-informed friends disagree on, which means suspending judgment about almost everything interesting. But despite appearances, the equal weight view does not have this absurd consequence. Furthermore, the view can be generalized to handle cases involving not just epistemic peers, but also epistemic superiors and inferiors. (shrink)

It has been claimed that epistemic peers, upon discovering that they disagree on some issue, should give up their opposing views and ‘split the difference’. The present paper challenges this claim by showing, with the help of computer simulations, that what the rational response to the discovery of peer disagreement is—whether it is sticking to one’s belief or splitting the difference—depends on factors that are contingent and highly context-sensitive.Keywords: Peer disagreement; Computer simulations; Opinion dynamics; Hegselmann–Krause model; Social epistemology.

Much of what we believe we know, we know through the testimony of others. While there has been long-standing evidence that people are sensitive to the characteristics of the sources of testimony, for example in the context of persuasion, researchers have only recently begun to explore the wider implications of source reliability considerations for the nature of our beliefs. Likewise, much remains to be established concerning what factors influence source reliability. In this paper, we examine, both theoretically and empirically, the (...) implications of using message content as a cue to source reliability. We present a set of experiments examining the relationship between source information and message content in people's responses to simple communications. The results show that people spontaneously revise their beliefs in the reliability of the source on the basis of the expectedness of a source's claim and, conversely, adjust message impact by perceived reliability; hence source reliability and message content have a bi-directional relationship. The implications are discussed for a variety of psychological, philosophical and political issues such as belief polarization and dual-route models of persuasion. (shrink)

Our trust in the word of others is often dismissed as unworthy, because the illusory ideal of "autonomous knowledge" has prevailed in the debate about the nature of knowledge. Yet we are profoundly dependent on others for a vast amount of what any of us claim to know. Coady explores the nature of testimony in order to show how it might be justified as a source of knowledge, and uses the insights that he has developed to challenge certain widespread assumptions (...) in the areas of history, law, mathematics, and psychology. (shrink)

A detailed treatment regarding the diverse properties and uses of evidence and the judgmental tasks they entail. Examines various processes by which evidence may be developed or discovered. Considers the construction of arguments made in defense of the relevance and credibility of individual items and masses of evidence as well as the task of assessing the inferential force of evidence. Includes over 100 numerical examples to illustrate the workings of diverse probabilistic expressions for the inferential force of evidence and the (...) subtleties they reveal. (shrink)

It is tempting to think that, if a person's beliefs are coherent, they are also likely to be true. This truth conduciveness claim is the cornerstone of the popular coherence theory of knowledge and justification. Erik Olsson's new book is the most extensive and detailed study of coherence and probable truth to date. Setting new standards of precision and clarity, Olsson argues that the value of coherence has been widely overestimated. Provocative and readable, Against Coherence will make stimulating reading for (...) epistemologists and anyone with a serious interest in truth. (shrink)

This book offers a concise survey of basic probability theory from a thoroughly subjective point of view whereby probability is a mode of judgment. Written by one of the greatest figures in the field of probability theory, the book is both a summation and synthesis of a lifetime of wrestling with these problems and issues. After an introduction to basic probability theory, there are chapters on scientific hypothesis-testing, on changing your mind in response to generally uncertain observations, on expectations of (...) the values of random variables, on de Finetti's dissolution of the so-called problem of induction, and on decision theory. (shrink)

Virtually everything we know depends in some way or other on the testimony of others—what we eat, how things work, where we go, even who we are. We do not, after all, perceive firsthand the preparation of the ingredients in many of our meals, or the construction of the devices we use to get around the world, or the layout of our planet, or our own births and familial histories. These are all things we are told. Indeed, subtracting from our (...) lives the information that we possess via testimony leaves them barely recognizable. Scientific discoveries, battles won and lost, geographical developments, customs and traditions of distant lands—all of these facts would be completely lost to us. It is, therefore, no surprise that the importance of testimony, both epistemological and practical, is nearly universally accepted. Less consensus, however, is found when questions about the nature and extent of our dependence on the word of others arise. Is our justified reliance on testimony fundamentally basic, for instance, or is it ultimately reducible to perception, memory, and reason? Is trust, or some related interpersonal feature of our social interaction with one another, essential to the acquisition of beliefs that are testimonially justified? Is testimonial knowledge necessarily acquired through transmission from speaker to hearer? Can testimony generate epistemic features in its own right? These are the questions that will be taken up in this paper and, as will become clear, their answers have far-reaching consequences for how we understand our place in the social world. (shrink)

The objectivity of Bayesian induction relies on the ability of evidence to produce a convergence to agreement among agents who initially disagree about the plausibilities of hypotheses. I will describe three sorts of Bayesian convergence. The first reduces the objectivity of inductions about simple "occurrent events" to the objectivity of posterior probabilities for theoretical hypotheses. The second reveals that evidence will generally induce converge to agreement among agents on the posterior probabilities of theories only if the convergence is 0 or (...) 1. The third establishes conditions under which evidence will very probably compel posterior probabilities of theories to converge to 0 or 1. (shrink)