Bayesian decision theory is here construed as explicating a particular concept of rational choice and Bayesian probability is taken to be the concept of probability used in that theory. Bayesian probability is usually identified with the agent’s degrees of belief but that interpretation makes Bayesian decision theory a poor explication of the relevant concept of rational choice. A satisfactory conception of Bayesian decision theory is obtained by taking Bayesian probability to (...) be an explicatum for inductive probability given the agent’s evidence. (shrink)

In standard Bayesian probability revision, the adoption of full beliefs (propositions with probability 1) is irreversible. Once an agent has full belief in a proposition, no subsequent revision can remove that belief. This is an unrealistic feature, and it also makes probability revision incompatible with belief change theory, which focuses on how the set of full beliefs is modified through both additions and retractions. This problem in probability theory can be solved in a model that (...) (i) lets the codomain of the probability function be a hyperreal-valued rather than the real-valued closed interval [0, 1], and (ii) identifies the full beliefs as the propositions whose probability is either 1 or infinitesimally smaller than 1. In this model, changes in the probability function will result in changes in the set of full beliefs (belief set), which constitutes a submodel that can be conceived as the “tip of the iceberg” within the larger model that also contains beliefs on lower levels of probability. The patterns of change in the set of full beliefs in this modified Bayesian model coincides with the corresponding pattern in a slightly modified version of AGM revision, which is commonly conceived as the gold standard of (dichotomous) belief change. The modification only concerns the marginal case of revision by an inconsistent input sentence. These results show that probability revision and dichotomous belief change can be unified in one and the same framework, or – if we so wish – that belief change theory can be subsumed under a modified version of probability revision that allows for iterated change and for the removal of full beliefs. (shrink)

Many philosophers have argued that "degree of belief" or "credence" is a more fundamental state grounding belief. Many other philosophers have been skeptical about the notion of "degree of belief", and take belief to be the only meaningful notion in the vicinity. This paper shows that one can take belief to be fundamental, and ground a notion of "degree of belief" in the patterns of belief, assuming that an agent has a collection of beliefs that isn't dominated by some other (...) collection in terms of the overall balance of truth and falsity that it could contain. (shrink)

Relevant to, and drawing from, a range of disciplines, the chapters in this collection show the diversity, and applicability, of research in Bayesian argumentation.

It is argued that we need a richer version of Bayesian decision theory, admitting both subjective and objective probabilities and providing rational criteria for choice of our prior probabilities. We also need a theory of tentative acceptance of empirical hypotheses. There is a discussion of subjective and of objective probabilities and of the relationship between them, as well as a discussion of the criteria used in choosing our prior probabilities, such as the principles of indifference and of maximum entropy, (...) and the simplicity ranking of alternative hypotheses. (shrink)

A diagnostic judgment of a teacher can be seen as an inference from manifest observable evidence on a student’s behavior to his or her latent traits. This can be described by a Bayesian model of in-ference: The teacher starts from a set of assumptions on the student (hypotheses), with subjective probabilities for each hypothesis (priors). Subsequently, he or she uses observed evidence (stu-dents’ responses to tasks) and knowledge on conditional probabilities of this evidence (likelihoods) to revise these assumptions. Many (...) systematic deviations from this model (biases, e.g. base-rate neglect, inverse fallacy) are reported in literature on Bayesian reasoning. In a teacher’s situation the information (hypotheses, priors, likelihoods) is usually not explicitly represented numerically (as in most research on Bayesian reasoning), but only by qualitative esti-mations in the mind of the teacher. In our study, we ask to which extent individuals (approximately) apply a rational Bayesian strategy or resort on other biased strategies of processing information for their diagnostic judgments. We explicitly pose this question with respect to non-numerical settings. To investigate this question, we developed a scenario that visually displays all relevant information (hypotheses, priors, likelihoods) in a graphically displayed hypothesis space (called “hypothegon”) – without recurring to numerical representations or mathematical procedures. 42 pre-service teach-ers were asked to judge the plausibility of different misconceptions of six students based on their responses to decimal comparison tasks (e.g. 3.39 > 3.4). Applying a Bayesian classification proce-dure, we identified three updating strategies: A Bayesian update strategy (BUS, processing all probabilities), a combined evidence strategy (CES, ignoring the prior probabilities but including all likelihoods), and a single evidence strategy (SES, only using the likelihood of the most probable hypothesis). In study 1, an instruction on the relevance of using all probabilities (priors and likelihoods) only weakly increased the processing of more information. In study 2, we found strong evidence that a visual explication of the prior-likelihood interaction led to an increase of processing the interaction of all relevant information. These results show that the phenomena found in general research on Bayesian reasoning in numerical settings extend to diagnostic judgments in non-numerical settings. (shrink)

In this chapter we draw connections between two seemingly opposing approaches to probability and statistics: evidential probability on the one hand and objective Bayesian epistemology on the other.

The generalized Bayes’ rule (GBR) can be used to conduct ‘quasi-Bayesian’ analyses when prior beliefs are represented by imprecise probability models. We describe a procedure for deriving coherent imprecise probability models when the event space consists of a finite set of mutually exclusive and exhaustive events. The procedure is based on Walley’s theory of upper and lower prevision and employs simple linear programming models. We then describe how these models can be updated using Cozman’s linear programming formulation (...) of the GBR. Examples are provided to demonstrate how the GBR can be applied in practice. These examples also illustrate the effects of prior imprecision and prior-data conflict on the precision of the posterior probability distribution. (shrink)

Algorithmic probability and friends: Proceedings of the Ray Solomonoff 85th memorial conference is a collection of original work and surveys. The Solomonoff 85th memorial conference was held at Monash University's Clayton campus in Melbourne, Australia as a tribute to pioneer, Ray Solomonoff, honouring his various pioneering works - most particularly, his revolutionary insight in the early 1960s that the universality of Universal Turing Machines could be used for universal Bayesian prediction and artificial intelligence. This work continues to increasingly (...) influence and under-pin statistics, econometrics, machine learning, data mining, inductive inference, search algorithms, data compression, theories of intelligence and philosophy of science - and applications of these areas. Ray not only envisioned this as the path to genuine artificial intelligence, but also, still in the 1960s, anticipated stages of progress in machine intelligence which would ultimately lead to machines surpassing human intelligence. Ray warned of the need to anticipate and discuss the potential consequences - and dangers - sooner rather than later. Possibly foremostly, Ray Solomonoff was a fine, happy, frugal and adventurous human being of gentle resolve who managed to fund himself while electing to conduct so much of his paradigm-changing research outside of the university system. The volume contains 35 papers pertaining to the abovementioned topics in tribute to Ray Solomonoff and his legacy. (shrink)

Given a few assumptions, the probability of a conjunction is raised, and the probability of its negation is lowered, by conditionalising upon one of the conjuncts. This simple result appears to bring Bayesian confirmation theory into tension with the prominent dogmatist view of perceptual justification – a tension often portrayed as a kind of ‘Bayesian objection’ to dogmatism. In a recent paper, David Jehle and Brian Weatherson observe that, while this crucial result holds within classical (...) class='Hi'>probability theory, it fails within intuitionistic probability theory. They conclude that the dogmatist who is willing to take intuitionistic logic seriously can make a convincing reply to the Bayesian objection. In this paper, I argue that this conclusion is premature – the Bayesian objection can survive the transition from classical to intuitionistic probability, albeit in a slightly altered form. I shall conclude with some general thoughts about what the Bayesian objection to dogmatism does and doesn’t show. (shrink)

This paper presents an effort to induce a Bayesian belief network (BBN) from crime data, namely the national crime victimization survey (NCVS). This BBN defines a joint probability distribution over a set of variables that were employed to record a set of crime incidents, with particular focus on characteristics of the victim. The goals are to generate a BBN to capture how characteristics of crime incidents are related to one another, and to make this information available to domain (...) specialists. The novelty associated with the study reported in this paper lies in the use of a Bayesian network to represent a complex data set to non-experts in a way that facilitates automated analysis. Validation of the BBN’s ability to approximate the joint probability distribution over the set of variables entailed in the NCVS data set is accomplished through a variety of sources including mathematical techniques and human experts for appropriate triangulation. Validation results indicate that the BBN induced from the NCVS data set is a good joint probability model for the set of attributes in the domain, and accordingly can serve as an effective query tool. (shrink)

Calibration inductive logics are based on accepting estimates of relative frequencies, which are used to generate imprecise probabilities. In turn, these imprecise probabilities are intended to guide beliefs and decisions — a process called “calibration”. Two prominent examples are Henry E. Kyburg's system of Evidential Probability and Jon Williamson's version of Objective Bayesianism. There are many unexplored questions about these logics. How well do they perform in the short-run? Under what circumstances do they do better or worse? What is (...) their performance relative to traditional Bayesianism? -/- In this article, we develop an agent-based model of a classic binomial decision problem, including players based on variations of Evidential Probability and Objective Bayesianism. We compare the performances of these players, including against a benchmark player who uses standard Bayesian inductive logic. We find that the calibrated players can match the performance of the Bayesian player, but only with particular acceptance thresholds and decision rules. Among other points, our discussion raises some challenges for characterising “cautious” reasoning using imprecise probabilities. Thus, we demonstrate a new way of systematically comparing imprecise probability systems, and we conclude that calibration inductive logics are surprisingly promising for making decisions. (shrink)

The theory of personal probability needs to be developed as a logic of credibility in order to provide an adequate basis for the theories of scientific inference and rational decision making. But standard systems of personal probability impose formal structures on probability relationships which are too restrictive to qualify them as logics of credibility. Moreover, some rules for conditional probability have no justification as principles of credibility. A formal system of qualitative probability which is free (...) of these defects and which leads to a presuppositionless representation theorem is sketched. (shrink)

Finland is internationally known as one of the leading centers of twentieth century analytic philosophy. This volume offers for the first time an overall survey of the Finnish analytic school. The rise of this trend is illustrated by original articles of Edward Westermarck, Eino Kaila, Georg Henrik von Wright, and Jaakko Hintikka. Contributions of Finnish philosophers are then systematically discussed in the fields of logic, philosophy of language, philosophy of science, history of philosophy, ethics and social philosophy. Metaphilosophical reflections on (...) the nature of philosophy are highlighted by the Finnish dialogue between analytic philosophy, phenomenology, pragmatism, and critical theory. (shrink)

Pi(AS) = Pi(A)Pi(S) for i = 1, 2. But the Linear Pool created a group opinion P3 with positive dependence. P3(A|S) > P3(A).

The formalism of operational statistics, a generalized approach to probability and statistics, provides a setting within which inference strategies can be studied with great clarity. This paper is concerned with the asymptotic behavior of the Bayesian inference strategy in this setting. We consider a sequence of posterior distributions, obtained from a prior as a result of successive conditionings by the events of an admissible sequence. We identify certain statistical hypotheses whose limiting posterior probabilities converge to one. We describe (...) these hypotheses, and show that when the prior is vague, they contain those probability models which represent the long-run relative frequencies of occurrence for the events in the sequence. (shrink)

In this article, I first give a short outline of the different interpretations of the concept of probability that emerged in the twentieth century. In what follows, I give an overview of the main problems and problematic concepts from the philosophy of probability and show how they relate to Bayesian inference. In this overview, I emphasise that the understanding of the main concepts related to different interpretations of probability influences the understanding and status of Bayesian (...) inference. In the conclusion, I express that, from a broad epistemological point of view, a kind of compatibilism between the two main lines of interpretations of probability is worth pursuing, as they represent different aspects of the epistemological process. (shrink)

For more than 20 years, research has proven the beneficial effect of natural frequencies when it comes to solving Bayesian reasoning tasks (Gigerenzer & Hoffrage, 1995). In a recent meta-analysis, McDowell & Jacobs (2017) showed that presenting a task in natural frequency format increases performance rates to 24% compared to only 4% when the same task is presented in probability format. Nevertheless, on average three quarters of participants in their meta-analysis failed to obtain the correct solution for such (...) a task in frequency format. In this paper, we present an empirical study on what participants typically do wrong when confronted with natural frequencies. We found that many of them did not actually use natural frequencies for their calculations, but translated them back into complicated probabilities instead. This switch from the intuitive presentation format to a less intuitive calculation format will be discussed within the framework of psychological theories (e.g., the Einstellung effect). (shrink)

According to the Bayesian view, scientific hypotheses must be appraised in terms of their posterior probabilities relative to the available experimental data. Such posterior probabilities are derived from the prior probabilities of the hypotheses by applying Bayes'theorem. One of the most important problems arising within the Bayesian approach to scientific methodology is the choice of prior probabilities. Here this problem is considered in detail w.r.t. two applications of the Bayesian approach: (1) the theory of inductive probabilities (TIP) (...) developed by Rudolf Carnap and other epistomologists and (2) the analysis of the multinational inferences provided by Bayesian statstics (BS). ... Zie: Summary. (shrink)

This article examines the effect of material evidence upon historiographic hypotheses. Through a series of successive Bayesian conditionalizations, I analyze the extended competition among several hypotheses that offered different accounts of the transition between the Bronze Age and the Iron Age in Palestine and in particular to the “emergence of Israel”. The model reconstructs, with low sensitivity to initial assumptions, the actual outcomes including a complete alteration of the scientific consensus. Several known issues of Bayesian confirmation, including the (...) problem of old evidence, the introduction and confirmation of novel theories and the sensitivity of convergence to uncertain and disputed evidence are discussed in relation to the model’s result and the actual historical process. The most important result is that convergence of probabilities and of scientific opinion is indeed possible when advocates of rival hypotheses hold similar judgment about the factual content of evidence, even if they differ sharply in their historiographic interpretation. This speaks against the contention that understanding of present remains is so irrevocably biased by theoretical and cultural presumptions as to make an objective assessment impossible. (shrink)

In his Bayesian Nets and Causality, Jon Williamson presents an ‘Objective Bayesian’ interpretation of probability, which he endeavours to distance from the logical interpretation yet associate with the subjective interpretation. In doing so, he suggests that the logical interpretation suffers from severe epistemological problems that do not affect his alternative. In this paper, I present a challenge to his analysis. First, I closely examine the relationship between the logical and ‘Objective Bayesian’ views, and show how, and (...) why, they are highly similar. Second, I argue that the logical interpretation is not manifestly inferior, at least for the reasons that Williamson offers. I suggest that the key difference between the logical and ‘Objective Bayesian’ views is in the domain of the philosophy of logic; and that the genuine disagreement appears to be over Platonism versus nominalism. (shrink)

Bayesian probability has recently been proposed as a normative theory of argumentation. In this article, we provide a Bayesian formalisation of the ad Hitlerum argument, as a special case of the ad hominem argument. Across three experiments, we demonstrate that people's evaluation of the argument is sensitive to probabilistic factors deemed relevant on a Bayesian formalisation. Moreover, we provide the first parameter-free quantitative evidence in favour of the Bayesian approach to argumentation. Quantitative Bayesian prescriptions (...) were derived from participants' stated subjective probabilities (Experiments 1 and 2), as well as from frequency information explicitly provided in the experiment (Experiment 3). Participants' stated evaluations of the convincingness of the argument were well matched to these prescriptions. (shrink)

As stochastic independence is essential to the mathematical development of probability theory, it seems that any foundational work on probability should be able to account for this property. Bayesian decision theory appears to be wanting in this respect. Savage’s postulates on preferences under uncertainty entail a subjective expected utility representation, and this asserts only the existence and uniqueness of a subjective probability measure, regardless of its properties. What is missing is a preference condition corresponding to stochastic (...) independence. To fill this significant gap, the article axiomatizes Bayesian decision theory afresh and proves several representation theorems in this novel framework. (shrink)

Hume’s celebrated argument concerning miracles, and an 18th century criticism of it put forward by Richard Price, is here interpreted in terms of the modern controversy over the base-rate fallacy. When considering to what degree we should trust a witness, should we or should we not take into account the prior probability of the event reported? The reliability of the witness (’Pr’(says e/e)) is distinguished from the credibility of the testimony (’Pr’(e/says e)), and it is argued that Hume, as (...) a good proto-Bayesian, argued that the credibility of the testimony should be calculated in terms of both the reliability of the witness and the prior probability of the event reported. (shrink)

The great advantage of Tenenbaum and Griffiths's model is that it incorporates both specific and general prior knowledge into category learning. Two phenomena are presented as supporting the detailed assumptions of this model. However, one phenomenon, effects of diversity, does not seem to require these assumptions, and the other phenomenon, effects of sample size, is not representative of most reported results. [Tenenbaum & Griffiths].

How should we reason in science? Jan Sprenger and Stephan Hartmann offer a refreshing take on classical topics in philosophy of science, using a single key concept to explain and to elucidate manifold aspects of scientific reasoning. They present good arguments and good inferences as being characterized by their effect on our rational degrees of belief. Refuting the view that there is no place for subjective attitudes in 'objective science', Sprenger and Hartmann explain the value of convincing evidence in terms (...) of a cycle of variations on the theme of representing rational degrees of belief by means of subjective probabilities (and changing them by Bayesian conditionalization). In doing so, they integrate Bayesian inference—the leading theory of rationality in social science—with the practice of 21st century science. Bayesian Philosophy of Science thereby shows how modeling such attitudes improves our understanding of causes, explanations, confirming evidence, and scientific models in general. It combines a scientifically minded and mathematically sophisticated approach with conceptual analysis and attention to methodological problems of modern science, especially in statistical inference, and is therefore a valuable resource for philosophers and scientific practitioners. (shrink)

Bayesian nets are widely used in artificial intelligence as a calculus for causal reasoning, enabling machines to make predictions, perform diagnoses, take decisions and even to discover causal relationships. This book, aimed at researchers and graduate students in computer science, mathematics and philosophy, brings together two important research topics: how to automate reasoning in artificial intelligence, and the nature of causality and probability in philosophy.

Stochastic independence has a complex status in probability theory. It is not part of the definition of a probability measure, but it is nonetheless an essential property for the mathematical development of this theory. Bayesian decision theorists such as Savage can be criticized for being silent about stochastic independence. From their current preference axioms, they can derive no more than the definitional properties of a probability measure. In a new framework of twofold uncertainty, we introduce preference (...) axioms that entail not only these definitional properties, but also the stochastic independence of the two sources of uncertainty. This goes some way towards filling a curious lacuna in Bayesian decision theory. (shrink)