We describe a computational model of two central aspects of people's probabilistic reasoning: descriptive probability estimation and inferential probability judgment. This model assumes that people's reasoning follows standard frequentist probability theory, but it is subject to random noise. This random noise has a regressive effect in descriptive probability estimation, moving probability estimates away from normative probabilities and toward the center of the probability scale. This random noise has an anti-regressive effect in inferential judgement, (...) however. These regressive and anti-regressive effects explain various reliable and systematic biases seen in people's descriptive probability estimation and inferential probability judgment. This model predicts that these contrary effects will tend to cancel out in tasks that involve both descriptive estimation and inferential judgement, leading to unbiased responses in those tasks. We test this model by applying it to one such task, described by Gallistel et al. ). Participants' median responses in this task were unbiased, agreeing with normative probability theory over the full range of responses. Our model captures the pattern of unbiased responses in this task, while simultaneously explaining systematic biases away from normatively correct probabilities seen in other tasks. (shrink)

It is important to reveal how humans evaluate an explanation of the recent development of explainable artificial intelligence. So, what makes people feel that one explanation is more likely than another? In the present study, we examine how explanatory virtues affect the process of estimating subjective posterior probability. Through systematically manipulating two virtues, Simplicity—the number of causes used to explain effects—and Scope—the number of effects predicted by causes—in three different conditions, we clarified two points in Experiment 1: that Scope's (...) effect is greater than Simplicity's; and that these virtues affect the outcome independently. In Experiment 2, we found that instruction about the explanatory structure increased the impact of both virtues' effects but especially that of Simplicity. These results suggest that Scope predominantly affects the estimation of subjective posterior probability, but that, if perspective on the explanatory structure is provided, Simplicity can also affect probability estimation. (shrink)

We describe a dual-process theory of how individuals estimate the probabilities of unique events, such as Hillary Clinton becoming U.S. President. It postulates that uncertainty is a guide to improbability. In its computer implementation, an intuitive system 1 simulates evidence in mental models and forms analog non-numerical representations of the magnitude of degrees of belief. This system has minimal computational power and combines evidence using a small repertoire of primitive operations. It resolves the uncertainty of divergent evidence for single events, (...) for conjunctions of events, and for inclusive disjunctions of events, by taking a primitive average of non-numerical probabilities. It computes conditional probabilities in a tractable way, treating the given event as evidence that may be relevant to the probability of the dependent event. A deliberative system 2 maps the resulting representations into numerical probabilities. With access to working memory, it carries out arithmetical operations in combining numerical estimates. Experiments corroborated the theory's predictions. Participants concurred in estimates of real possibilities. They violated the complete joint probability distribution in the predicted ways, when they made estimates about conjunctions: P, P, P, disjunctions: P, P, P, and conditional probabilities P, P, P. They were faster to estimate the probabilities of compound propositions when they had already estimated the probabilities of each of their components. We discuss the implications of these results for theories of probabilistic reasoning. (shrink)

This article presents the results of a survey designed to test, with economically sophisticated participants, Ellsberg’s ambiguity aversion hypothesis, and Smithson’s conflict aversion hypothesis. Based on an original sample of 78 professional actuaries (all members of the French Institute of Actuaries), this article provides empirical evidence that ambiguity (i.e. uncertainty about the probability) affect insurers’ decision on pricing insurance. It first reveals that premiums are significantly higher for risks when there is ambiguity regarding the probability of the loss. (...) Second, it shows that insurers are sensitive to sources of ambiguity. The participants indeed, charged a higher premium when ambiguity came from conflict and disagreement regarding the probability of the loss than when ambiguity came from imprecision (imprecise forecast about the probability of the loss). This research thus documents the presence of both ambiguity aversion and conflict aversion in the field of insurance, and discuses economic and psychological rationales for the observed behaviours. (shrink)

The author recently claimed that Pr(P, Q), where Pr is a probability function and P and Q are two sentences of a formalized language L, qualifies as an estimate--made in the light of Q--of the truth-value of P in L. To substantiate his claim, the author establishes here that the two strategies lying at the opposite extremes of the spectrum of truth-value estimating strategies meet the first five of the six requirements (R1-R6) currently placed upon probability functions and (...) fail to meet the sixth one. He concludes from those two results that the value for P and Q of any function satisfying R1-R5 must rate "minimally satisfactory" and the value for P and Q of any function satisfying R1-R6 must rate "satisfactory" as an estimate--made in the light of Q--of the truth-value of P in L. (shrink)

We human beings have evolved with brains that have amazing capabilities for rational thought, pattern recognition, judgment, creativity, and imagination, none of which can be readily duplicated by the best computer simulations. However, there is one area, in which the human brain is sadly lacking: the ability to accurately assess probabilities and act on these assessments. The successes of lotteries, Las Vegas, and tribal casinos provide ample evidence that when it comes to estimating the odds and acting accordingly, we humans (...) as a species are really deficient. We think that “winning streaks†are real, that slot machines are “overdue†for a jackpot, that the past pattern of random events somehow influences the odds for the next event. (shrink)

There is a vast literature that seeks to uncover features underlying moral judgment by eliciting reactions to hypothetical scenarios such as trolley problems. These thought experiments assume that participants accept the outcomes stipulated in the scenarios. Across seven studies, we demonstrate that intuition overrides stipulated outcomes even when participants are explicitly told that an action will result in a particular outcome. Participants instead substitute their own estimates of the probability of outcomes for stipulated outcomes, and these probability (...) estimates in turn influence moral judgments. Our findings demonstrate that intuitive likelihoods are one critical factor in moral judgment, one that is not suspended even in moral dilemmas that explicitly stipulate outcomes. Features thought to underlie moral reasoning, such as intention, may operate, in part, by affecting the intuitive likelihood of outcomes, and, problematically, moral differences between scenarios may be confounded with non-moral intuitive probabilities. (shrink)

ABSTRACTPeople high in negative affect tend to think negative events are more likely than positive events. Studies have found that weak attentional control exaggerates another...

Two experiments using a realistic version of the selection task examined the relationship between participants' probability estimates of finding a counter example and their selections. Experiment 1 used everyday categories in the context of a scenario to determine whether or not the number of instances in a category affected the estimated probability of a counter-example. Experiment 2 modified the scenario in order to alter participants' estimates of finding a specific counter-example. Unlike Kirby 1994a, but consistent with (...) his proposals, both studies showed that probability estimates significantly predicted selection. Overall results point to the value of understanding selections in terms of their subjective expected utility. (shrink)

We consider a panel of experts asked to assign probabilities to events, both logically simple and complex. The events evaluated by different experts are based on overlapping sets of variables but may otherwise be distinct. The union of all the judgments will likely be probabilistic incoherent. We address the problem of revising the probability estimates of the panel so as to produce a coherent set that best represents the group’s expertise.

This paper presents a decision theory which allows subjects to account for the uncertainties of their probability estimates. This is accomplished by modelling beliefs about states of nature by means of a class of probability measures. In order to represent uncertainties of those beliefs a measure of epistemic reliability is introduced. The suggested decision theory is evaluated in the light of empirical evidence on ambiguity and uncertainty in decision making. The theory is also compared to Tversky & (...) Kahneman's prospect theory. (shrink)

A pluralistic scientific method is one that incorporates a variety of points of view in scientific inquiry. This paper investigates one example of pluralistic method: the use of weighted averaging in probability estimation. I consider two methods of weight determination, one based on disjoint evidence possession and the other on track record. I argue that weighted averaging provides a rational procedure for probability estimation under certain conditions. I consider a strategy for calculating ‘mixed weights’ which incorporate mixed information (...) about agent credibility. I address various objections to the weighted averaging technique and conclude that the technique is a promising one in various respects. (shrink)

‘Probability logic’ might seem like an oxymoron. Logic traditionally concerns matters immutable, necessary and certain, while probability concerns the uncertain, the random, the capricious. Yet our subject has a distinguished pedigree. Ramsey begins his classic “Truth and Probability” with the words: “In this essay the Theory of Probability is taken as a branch of logic. … “speaks of “the logic of the probable.” And more recently, regards probabilities as estimates of truth values, and thus (...) class='Hi'>probability theory as a natural outgrowth of two‐valued logic—what he calls “probability logic.” However the point is put, probability theory and logic are clearly intimately related. This chapter explores some of the multifarious connections between probability and logic, and focuses on various philosophical issues in the foundations of probability theory. (shrink)

PROBEX (PROBabilities from EXemplars), a model of probabilistic inference and probability judgment based on generic knowledge is presented. Its properties are that: (a) it provides an exemplar model satisfying bounded rationality; (b) it is a “lazy” algorithm that presumes no pre‐computed abstractions; (c) it implements a hybrid‐representation, similarity‐graded probability. We investigate the ecological rationality of PROBEX and find that it compares favorably with Take‐The‐Best and multiple regression (Gigerenzer, Todd, & the ABC Research Group, 1999). PROBEX is fitted to (...) the point estimates, decisions, and probability assessments by human participants. The best fit is obtained for a version that weights frequency heavily and retrieves only two exemplars. It is proposed that PROBEX implements speed and frugality in a psychologically plausible way. (shrink)

“What data will show the truth?” is a fundamental question emerging early in any empirical investigation. From a statistical perspective, experimental design is the appropriate tool to address this question by ensuring control of the error rates of planned data analyses and of the ensuing decisions. From an epistemological standpoint, planned data analyses describe in mathematical and algorithmic terms a pre-specified mapping of observations into decisions. The value of exploratory data analyses is often less clear, resulting in confusion about what (...) characteristics of design and analysis are necessary for decision making and what may be useful to inspire new questions. This point is addressed here by illustrating the Popper-Miller theorem in plain terms and using a graphical support. Popper and Miller proved that probability estimates cannot generate hypotheses on behalf of investigators. Consistently with Popper-Miller, we show that probability estimation can only reduce uncertainty about the truth of a merely possible hypothesis. This fact clearly identifies exploratory analysis as one of the tools supporting a dynamic process of hypothesis generation and refinement which cannot be purely analytic. A clear understanding of these facts will enable stakeholders, mathematical modellers and data analysts to better engage on a level playing field when designing experiments and when interpreting the results of planned and exploratory data analyses. (shrink)

We propose a theory that relates perceived evidence to numerical probability judgment. The most successful prior account of this relation is Support Theory, advanced in Tversky and Koehler. Support Theory, however, implies additive probability estimates for binary partitions. In contrast, superadditivity has been documented in Macchi, Osherson, and Krantz, and both sub- and superadditivity appear in the experiments reported here. Nonadditivity suggests asymmetry in the processing of focal and nonfocal hypotheses, even within binary partitions. We extend Support (...) Theory by revising its basic equation to allow such asymmetry, and compare the two equations’ ability to predict numerical assessments of probability from scaled estimates of evidence for and against a given proposition. Both between- and within-subject experimental designs are employed for this purpose. We find that the revised equation is more accurate than the original Support Theory equation. The implications of asymmetric processing on qualitative assessments of chance are also briefly discussed. (shrink)

Probability is sometimes regarded as a universal panacea for epistemology. It has been supposed that the rationality of belief is almost entirely a matter of probabilities. Unfortunately, those philosophers who have thought about this most extensively have tended to be probability theorists first, and epistemologists only secondarily. In my estimation, this has tended to make them insensitive to the complexities exhibited by epistemic justification. In this paper I propose to turn the tables. I begin by laying out some (...) rather simple and uncontroversial features of the structure of epistemic justification, and then go on to ask what we can conclude about the connection between epistemology and probability in the light of those features. My conclusion is that probability plays no central role in epistemology. This is not to say that probability plays no role at all. In the course of the investigation, I defend a pair of probabilistic acceptance rules which enable us, under some circumstances, to arrive at justified belief on the basis of high probability. But these rules are of quite limited scope. The effect of there being such rules is merely that probability provides one source for justified belief, on a par with perception, memory, etc. There is no way probability can provide a universal cure for all our epistemological ills. (shrink)

In concrete applications of probability, statistical investigation gives us knowledge of some probabilities, but we generally want to know many others that are not directly revealed by our data. For instance, we may know prob(P/Q) (the probability of P given Q) and prob(P/R), but what we really want is prob(P/Q& R), and we may not have the data required to assess that directly. The probability calculus is of no help here. Given prob(P/Q) and prob(P/R), it is consistent (...) with the probability calculus for prob(P/Q& R) to have any value between 0 and 1. Is there any way to make a reasonable estimate of the value of prob(P/Q& R) 1 A related problem occurs when probability practitioners adopt undefended assumptions of statistical independence simply on the basis of not seeing any connection between two propositions. This is common practice, but its justification has eluded probability theorists, and researchers are typically apologetic about making such assumptions. Is there any way to defend the practice? This paper shows that on a certain conception of probability—nomic probability—there are principles of "probable probabilities" that license inferences of the above sort. These are principles telling us that although certain inferences from probabilities to probabilities are not deductively valid, nevertheless the second-order probability of their yielding correct results is 1. This makes it defeasibly reasonable to make the inferences. Thus I argue that it is defeasibly reasonable to assume statistical independence when we have no information to the contrary. And I show that there is a function Y(r, s, a) such that if prob(P/Q) = r, prob(P/R) = s, andprob(P/U) = a (where U is our background knowledge) then it is defeasibly reasonable to expect that prob(P/Q&R) = Y(r, s, a). Numerous other defeasible inferences are licensed by similar principles of probable probabilities. This has the potential to greatly enhance the usefulness of probabilities in practical application. (shrink)

We conduct a standardized survey on risk preferences in 53 countries worldwide and estimate cumulative prospect theory parameters from the data. The parameter estimates show that significant differences on the cross-country level are to some extent robust and related to economic and cultural differences. In particular, a closer look on probability weighting underlines gender differences, economic effects, and cultural impact on probability weighting. The data set is a useful starting point for future research that investigates the impact (...) of risk preferences on the market level. (shrink)

Professor Meehl [2] has pointed out a very significant problem in the methodology of psychological research, indicating that statistical tests of psychological hypotheses against a null hypothesis are loaded in favor of eventual success at rejecting the null hypothesis. In my opinion this is not, however, a contrast between physics and psychology, but rather between the method of parameter estimation and that of the null hypothesis in the tradition of Fisher. A physicist could use the null hypothesis method as well (...) as the psychologist. The fact that he doesn't is probably related to the more advanced state of his measurement techniques and theoretical constructs. (shrink)

When people are asked to estimate the probabilities of uncertain events, they often neglect the additivity principle, which requires that the probabilities assigned to an exhaustive set of outcomes should add up to 100%. Previous studies indicate that additivity neglect is dependent on response format, self-generated probability estimates being more coherent than estimates on rating scales. The present study made use of eye-tracking methodology, recording the movement, frequency and duration of fixations during the solution of ten additivity (...) problems and two control tasks. Participants produced more non-additive estimates in the Scale format than in the Self-generated format. Self-generated estimates also led to longer decision time and a higher number of repeated inspections, suggesting a deliberate comparison process. In contrast, the Scale format seemed to encourage a case-based approach where each outcome is evaluated in isolation. (shrink)

Probability plays an essential role in many branches of AI, where it is typically assumed that we have a complete probability distribution when addressing a problem. But this is unrealistic for problems of real-world complexity. Statistical investigation gives us knowledge of some probabilities, but we generally want to know many others that are not directly revealed by our data. For instance, we may know prob(P/Q) (the probability of P given Q) and prob(P/R), but what we really want (...) is prob(P/Q&R), and we may not have the data required to assess that directly. The probability calculus is of no help here. Given prob(P/Q) and prob(P/R), it is consistent with the probability calculus for prob(P/Q&R) to have any value between 0 and 1. Is there any way to make a reasonable estimate of the value of prob(P/Q&R)? A related problem occurs when probability practitioners adopt undefended assumptions of statistical independence simply on the basis of not seeing any connection between two propositions. This is common practice, but its justification has eluded probability theorists, and researchers are typically apologetic about making such assumptions. Is there any way to defend the practice? This paper shows that on a certain conception of probability — nomic probability — there are principles of “probable probabilities” that license inferences of the above sort. These are principles telling us that although certain inferences from probabilities to probabilities are not deductively valid, nevertheless the second-order probability of their yielding correct results is 1. This makes it defeasibly reasonable to make the inferences. Thus I argue that it is defeasibly reasonable to assume statistical independence when we have no information to the contrary. And I show that there is a function Y(r,s:a) such that if prob(P/Q) = r, prob(P/R) = s, and prob(P/U) = a (where U is our background knowledge) then it is defeasibly reasonable to expect that prob(P/Q&R) = Y(r,s:a).. (shrink)

Notions of probability and uncertainty have been increasingly prominant in modern economics. This book considers the philosophical and practical difficulties inherent in integrating these concepts into realistic economic situations. It outlines and evaluates the major developments, indicating where further work is needed. This book addresses: * probability, utility and rationality within current economic thought and practice * concepts of ignorance and indeterminancy * experimental economics * econometrics, with particular reference inference and estimation.

In concrete applications of probability, statistical investigation gives us knowledge of some probabilities, but we generally want to know many others that are not directly revealed by our data. For instance, we may know prob(P/Q) (the probability of P given Q) and prob(P/R), but what we really want is prob(P/Q&R), and we may not have the data required to assess that directly. The probability calculus is of no help here. Given prob(P/Q) and prob(P/R), it is consistent with (...) the probability calculus for prob(P/Q&R) to have any value between 0 and 1. Is there any way to make a reasonable estimate of the value of prob(P/Q&R)? A related problem occurs when probability practitioners adopt undefended assumptions of statistical independence simply on the basis of not seeing any connection between two propositions. This is common practice, but its justification has eluded probability theorists, and researchers are typically apologetic about making such assumptions. Is there any way to defend the practice? This paper shows that on a certain conception of probability — nomic probability — there are principles of “probable probabilities” that license inferences of the above sort. These are principles telling us that although certain inferences from probabilities to probabilities are not deductively valid, nevertheless the second-order probability of their yielding correct results is 1. This makes it defeasibly reasonable to make the inferences. Thus I argue that it is defeasibly reasonable to assume statistical independence when we have no information to the contrary. And I show that there is a function Y(r,s:a) such that if prob(P/Q) = r, prob(P/R) = s, and prob(P/U) = a (where U is our background knowledge) then it is defeasibly reasonable to expect that prob(P/Q&R) = Y(r,s:a). Numerous other defeasible inferences are licensed by similar principles of probable probabilities.. (shrink)

��The Coherent Approximation Principle (CAP) is a method for aggregating forecasts of probability from a group of judges by enforcing coherence with minimal adjustment. This paper explores two methods to further improve the forecasting accuracy within the CAP framework and proposes practical algorithms that implement them. These methods allow flexibility to add fixed constraints to the coherentization process and compensate for the psychological bias present in probability estimates from human judges. The algorithms were tested on a data (...) set of nearly half a million probability estimates of events related to the 2008 U.S. presidential election (from about 16000 judges). The results show that both methods improve the stochastic accuracy of the aggregated forecasts compared to using simple CAP. (shrink)

The paper addresses a puzzle about the probabilistic evaluation of counterfactuals, raised by Ernest Adams as a problem for his own theory. I discuss Brian Skyrms’s response to the puzzle. I compare this puzzle with other puzzles about counterfactuals that have arisen more recently. And I attempt to solve the puzzle in a way that is consistent with Adams’s proposal about counterfactuals.

Studies of multiple paternity in mammals and other animal species generally report proportion of multiple paternity among litters, mean litter sizes, and mean number of sires per litter. It is shown how these variables can be used to produce an estimate of the probability of reproductive success for a male that has mated with a female. This estimate of male success is more informative about the mating system that alternative measures, like the proportion of litters with multiple paternity or (...) the mean number of sires per litter. The probability of success for a mated male can be measured both theoretically and empirically, and gives an estimate of the intensity of sperm competition and of a male's “confidence of paternity” upon mating. The probability of success for mated males for ten “exemplar” species of mammals is estimated and they are compared for insights into the functioning of their mating systems. (shrink)

An unknown process is generating a sequence of symbols, drawn from an alphabet, A. Given an initial segment of the sequence, how can one predict the next symbol? Ray Solomonoff’s theory of inductive reasoning rests on the idea that a useful estimate of a sequence’s true probability of being outputted by the unknown process is provided by its algorithmic probability (its probability of being outputted by a species of probabilistic Turing machine). However algorithmic probability is a (...) “semimeasure”: i.e., the sum, over all x∈A, of the conditional algorithmic probabilities of the next symbol being x, may be less than 1. Prevailing wisdom has it that algorithmic probability must be normalized, to eradicate this semimeasure property, before it can yield acceptable probability estimates. This paper argues, to the contrary, that the semimeasure property contributes substantially to the power and scope of an algorithmic-probability-based theory of induction, and that normalization is unnecessary. (shrink)

Can heritability estimates provide causal information? This paper argues for an affirmative answer: since a non-nil heritability estimate satisfies certain characteristic properties of causation (i.e., association, manipulability, and counterfactual dependence), it increases the probability that the relation between genotypic variance and phenotypic variance is (at least partly) causal. Contrary to earlier proposals in the literature, the argument does not assume the correctness of any particular conception of the nature of causation, rather focusing on properties that are characteristic of (...) causal relationships. The argument is defended against Lewontin's (1974) locality objection and Kaplan and Turkheimer's (2021) recent critique of Genome-Wide Association Studies (GWAS). (shrink)