Frequentism

This paper offers a metaphysics of physical probability in (or if you prefer, truth conditions for probabilistic claims about) deterministic systems based on an approach to the explanation of probabilistic patterns in deterministic systems called the method of arbitrary functions. Much of the appeal of the method is its promise to provide an account of physical probability on which probability assignments have the ability to support counterfactuals about frequencies. It is argued that the eponymous arbitrary functions are of little philosophical (...) use, but that they can be substituted for facts about frequencies without losing the ability to provide counterfactual support. The result is an account of probability in deterministic systems that has a “propensity-like” look and feel, yet which requires no supplement to the standard modern empiricist tool kit of particular matters of fact and principles of physical dynamics. (shrink)

The inflation of Type I error rates is thought to be one of the causes of the replication crisis. Questionable research practices such as p-hacking are thought to inflate Type I error rates above their nominal level, leading to unexpectedly high levels of false positives in the literature and, consequently, unexpectedly low replication rates. In this article, I offer an alternative view. I argue that questionable and other research practices do not usually inflate relevant Type I error rates. I begin (...) with an introduction to Type I error rates that distinguishes them from theoretical errors. I then illustrate my argument with respect to model misspecification, multiple testing, selective inference, forking paths, exploratory analyses, p-hacking, optional stopping, double dipping, and HARKing. In each case, I demonstrate that relevant Type I error rates are not usually inflated above their nominal level, and in the rare cases that they are, the inflation is easily identified and resolved. I conclude that the replication crisis may be explained, at least in part, by researchers’ misinterpretation of statistical errors and their underestimation of theoretical errors. (shrink)

In the following we will investigate whether von Mises’ frequency interpretation of probability can be modified to make it philosophically acceptable. We will reject certain elements of von Mises’ theory, but retain others. In the interpretation we propose we do not use von Mises’ often criticized ‘infinite collectives’ but we retain two essential claims of his interpretation, stating that probability can only be defined for events that can be repeated in similar conditions, and that exhibit frequency stabilization. The central idea (...) of the present article is that the mentioned ‘conditions’ should be well-defined and ‘partitioned’. More precisely, we will divide probabilistic systems into object, initializing, and probing subsystem, and show that such partitioning allows to solve problems. Moreover we will argue that a key idea of the Copenhagen interpretation of quantum mechanics (the determinant role of the observing system) can be seen as deriving from an analytic definition of probability as frequency. Thus a secondary aim of the article is to illustrate the virtues of analytic definition of concepts, consisting of making explicit what is implicit. (shrink)

Like Lewis, many philosophers hold reductionist accounts of chance (on which claims about chance are to be understood as claims that certain patterns of events are instantiated) and maintain that rationality requires that credence should defer to chance (in the sense that under certain circumstances one's credence in an event must coincide with the chance of that event). It is a shortcoming of an account of chance if it implies that this norm of rationality is unsatisfiable by computable agents. This (...) shortcoming is more common than one might have hoped. (shrink)

Hájek (Erkenntnis 70(2):211–235, 2009) argues that probabilities cannot be the limits of relative frequencies in counterfactual infinite sequences. I argue for a different understanding of these limits, drawing on Norton’s (Philos Sci 79(2):207–232, 2012) distinction between approximations (inexact descriptions of a target) and idealizations (separate models that bear analogies to the target). Then, I adapt Hájek’s arguments to this new context. These arguments provide excellent reasons not to use hypothetical frequencies as idealizations, but no reason not to use them as (...) approximations. (shrink)

In this paper, we illustrate some serious difficulties involved in conveying information about uncertain risks and securing informed consent for risky interventions in a clinical setting. We argue that in order to secure informed consent for a medical intervention, physicians often need to do more than report a bare, numerical probability value. When probabilities are given, securing informed consent generally requires communicating how probability expressions are to be interpreted and communicating something about the quality and quantity of the evidence for (...) the probabilities reported. Patients may also require guidance on how probability claims may or may not be relevant to their decisions, and physicians should be ready to help patients understand these issues. (shrink)

This M.A. thesis explores the intricate Problem of Induction, contrasting three seminal approaches: Hume's habit-centric view, Reichenbach's emphasis on the Principle of Uniformity of Nature, and Strawson's belief in the innate rationality of induction. While Hume's perspective lays the groundwork for Kant's a priori and Cleve's a posteriori validation, Reichenbach and Salmon present pragmatic justifications, underscoring the methodological and probabilistic underpinnings of inductive reasoning, specifying epistemological ignorance as a guidance for the optimality criteria. Strawson, challenging prevailing notions, posits that induction, (...) anchored by prior probabilities and evidence, is inherently rational, obviating the need for external validation. The study integrates concepts of frequentism, conditionalization, and probabilistic laws to develop the truth-conducive nuance of induction. The research culminates by confronting the dual challenges of quantitative and profound scepticism, championing a holistic approach. Therefore, the study aims to enrich the discourse on the epistemic foundations of the Problem of Induction, particularly its implications for scientific inquiry and the laws of nature. (shrink)

Book Review of Kenneth Westphal's Kant’s Critical Epistemology: Why Epistemology Must Consider Judgment First.

European Journal of Philosophy, Volume 30, Issue 2, Page 823-839, June 2022.

Philosophers now seem to agree that frequentism is an untenable strategy to explain the meaning of probabilities. Nevertheless, I want to revive frequentism, and I will do so by grounding probabilities on typicality in the same way as the thermodynamic arrow of time can be grounded on typicality within statistical mechanics. This account, which I will call typicality frequentism, will evade the major criticisms raised against previous forms of frequentism. In this theory, probabilities arise within a physical theory from statistical (...) behavior of almost all initial conditions. The main advantage of typicality frequentism is that it shows which kinds of probabilities (that also have empirical relevance) can be derived from physics. Although one cannot recover all probability talk in this account, this is rather a virtue than a vice, because it shows which types of probabilities can in fact arise from physics and which types need to be explained in different ways, thereby opening the path for a pluralistic account of probabilities. (shrink)

Laura Papish’s Kant on Evil, Self-Deception, and Moral Reform is an ambitious attempt to breath new life into old debates and a welcome contribution to a recent renaissance of interest in Kant’s theory of evil. ​The book has eight chapters, and these chapters fall into three main divisions. Chapters 1 and 2 focus on the psychology of nonmoral and immoral action. Chapters 3, 4, and 5 focus on self-deception, evil, and dissimulation. And chapters 6, 7, and 8 focus on self-cognition, (...) moral reform, and moral progress. I shall begin with a brief summary of these chapters. Then I shall turn to commentary. (shrink)

The debates between Bayesian, frequentist, and other methodologies of statistics have tended to focus on conceptual justifications, sociological arguments, or mathematical proofs of their long run properties. Both Bayesian statistics and frequentist (“classical”) statistics have strong cases on these grounds. In this article, we instead approach the debates in the “Statistics Wars” from a largely unexplored angle: simulations of different methodologies’ performance in the short to medium run. We conducted a large number of simulations using a straightforward decision problem based (...) around tossing a coin with unknown bias and then placing bets. In this simulation, we programmed four players, inspired by Bayesian statistics, frequentist statistics, Jon Williamson’s version of Objective Bayesianism, and a player who simply extrapolates from observed frequencies to general frequencies. The last player functions as a benchmark: a statistical methodology should at least outperform a crude form of induction. We focused on the performance of these methodologies in guiding the players towards good decisions. Unlike an earlier simulation study of this type, we found no systematic difference in performance between the Bayesian and frequentist players, provided the Bayesian used a flat prior and the frequentist used a low confidence level. Unlike that study, we were able to use Big Data methods to mitigate problems of random error in the simulation results. The Williamsonian player, who is a novel element of our study, also had no systematic differences in their performance, provided that they use a low confidence level. These players performed similarly even in the very short run, when players were making different decisions. Our study indicates that all three methodologies should be taken seriously by philosophers and practitioners of statistics. However, the frequentist and Williamsonian performed poorly when their confidence levels were high, and the Bayesian was surprisingly harmed by biased priors, providing some unexpected lessons for these methodologies when facing this type of decision problem. (shrink)

The replication crisis has caused researchers to distinguish between exact replications, which duplicate all aspects of a study that could potentially affect the results, and direct replications, which duplicate only those aspects of the study that are thought to be theoretically essential to reproduce the original effect. The replication crisis has also prompted researchers to think more carefully about the possibility of making Type I errors when rejecting null hypotheses. In this context, the present article considers the utility of two (...) types of Type I error probability: the Neyman–Pearson long run Type I error rate and the Fisherian sample-specific Type I error probability. It is argued that the Neyman–Pearson Type I error rate is inapplicable in social science because it refers to a long run of exact replications, and social science deals with irreversible units that make exact replications impossible. Instead, the Fisherian sample-specific Type I error probability is recommended as a more meaningful way to conceptualize false positive results in social science because it can be applied to each sample-specific decision about rejecting the same substantive null hypothesis in a series of direct replications. It is concluded that the replication crisis may be partly due to researchers’ unrealistic expectations about replicability based on their consideration of the Neyman–Pearson Type I error rate across a long run of exact replications. (shrink)

Fisher criticised the Neyman-Pearson approach to hypothesis testing by arguing that it relies on the assumption of “repeated sampling from the same population.” The present article considers the responses to this criticism provided by Pearson and Neyman. Pearson interpreted alpha levels in relation to imaginary replications of the original test. This interpretation is appropriate when test users are sure that their replications will be equivalent to one another. However, by definition, scientific researchers do not possess sufficient knowledge about the relevant (...) and irrelevant aspects of their tests and populations to be sure that their replications will be equivalent to one another. Pearson also interpreted the alpha level as a personal rule that guides researchers’ behavior during hypothesis testing. However, this interpretation fails to acknowledge that the same researcher may use different alpha levels in different testing situations. Addressing this problem, Neyman proposed that the average alpha level adopted by a particular researcher can be viewed as an indicator of that researcher’s typical Type I error rate. Researchers’ average alpha levels may be informative from a metascientific perspective. However, they are not useful from a scientific perspective. Scientists are more concerned with the error rates of specific tests of specific hypotheses, rather than the error rates of their colleagues. It is concluded that neither Neyman nor Pearson adequately rebutted Fisher’s “repeated sampling” criticism. Fisher’s significance testing approach is briefly considered as an alternative to the Neyman-Pearson approach. (shrink)

I argue that none of the usual interpretations of probability provide an adequate interpretation of probabilistic theories in science. Assuming that the aim of such theories is to capture noisy relationships in the world, I suggest that we do not have to give them classical truth-conditional content at all: their probabilities can remain uninterpreted. Indirectly, this account turns out to explain what is right about the frequency interpretation, the best-systems interpretation, and the epistemic interpretation.

A. W. F. Edwards is one of the most influential mathematical geneticists in the history of the discipline. One of the last students of R. A. Fisher, Edwards pioneered the statistical analysis of phylogeny in collaboration with L. L. Cavalli-Sforza, and helped establish Fisher's concept of likelihood as a standard of statistical and scientific inference. In this book, edited by philosopher of science Rasmus Grønfeldt Winther, Edwards's key papers are assembled alongside commentaries by leading scientists, discussing Edwards's influence on their (...) own research and on thinking in their field overall. In an extensive interview with Winther, Edwards offers his thoughts on his contributions, their legacy, and the context in which they emerged. This book is a resource both for anyone interested in the history and philosophy of genetics, statistics, and science, and for scientists seeking to develop new algorithmic and statistical methods for understanding the genetic relationships between and among species both extant and extinct. (shrink)

Where E is the proposition that [If H and O were true, H would explain O], William Roche and Elliot Sober have argued that P(H|O&E) = P(H|O). In this paper I argue that not only is this equality not generally true, it is false in the very kinds of cases that Roche and Sober focus on, involving frequency data. In fact, in such cases O raises the probability of H only given that there is an explanatory connection between them.

Amidst long-running debates within the field, high energy physics has adopted a statistical methodology that primarily employs standard frequentist techniques such as significance testing and confidence interval estimation, but incorporates Bayesian methods for limited purposes. The discovery of the Higgs boson has drawn increased attention to the statistical methods employed within HEP. Here I argue that the warrant for the practice in HEP of relying primarily on frequentist methods can best be understood as pragmatic, in the sense that statistical methods (...) are chosen for their suitability for the practical demands of experimental HEP, rather than reflecting a commitment to a particular epistemic framework. In particular, I argue that understanding the statistical methodology of HEP through the perspective of pragmatism clarifies the role of and rationale for significance testing in the search for new phenomena such as the Higgs boson. (shrink)

Most ethical decisions are conditioned by formidable uncertainty. Decision makers may lack reliable information about relevant facts, the consequences of actions, and the reactions of other people. Resources for dealing with uncertainty are available from standard forms of decision theory, but successful application to decisions under risk requires a great deal of quantitative information: point-valued probabilities of states and point-valued utilities of outcomes. When this information is not available, this paper recommends the use of a form of decision theory that (...) operates on a bare minimum of information inputs: comparative plausibilities of states and comparative utilities of outcomes. In addition, it proposes a comparative strategy for dealing with second-order uncertainty. The paper illustrates its proposal with reference to a well-known ethical dilemma: Kant’s life-saving lie. (shrink)

Early work on the frequency theory of probability made extensive use of the notion of randomness, conceived of as a property possessed by disorderly collections of outcomes. Growing out of this work, a rich mathematical literature on algorithmic randomness and Kolmogorov complexity developed through the twentieth century, but largely lost contact with the philosophical literature on physical probability. The present chapter begins with a clarification of the notions of randomness and probability, conceiving of the former as a property of a (...) sequence of outcomes, and the latter as a property of the process generating those outcomes. A discussion follows of the nature and limits of the relationship between the two notions, with largely negative verdicts on the prospects for any reduction of one to the other, although the existence of an apparently random sequence of outcomes is good evidence for the involvement of a genuinely chancy process. (shrink)

Probability theory is a key tool of the physical, mathematical, and social sciences. It has also been playing an increasingly significant role in philosophy: in epistemology, philosophy of science, ethics, social philosophy, philosophy of religion, and elsewhere. This Handbook encapsulates and furthers the influence of philosophy on probability, and of probability on philosophy. Nearly forty articles summarise the state of play and present new insights in various areas of research at the intersection of these two fields. The articles will be (...) of special interest to practitioners of probability who seek a greater understanding of its mathematical and conceptual foundations, and to philosophers who want to get up to speed on the cutting edge of research in this area. The volume begins with a primer on those parts of probability theory that we believe are most important for philosophers to know, and the rest is divided into seven main sections: History; Formalism; Alternatives to Standard Probability Theory; Interpretations and Interpretive Issues; Probabilistic Judgment and Its Applications; Applications of Probability: Science; and Applications of Probability: Philosophy. (shrink)

The p value is the probability under the null hypothesis of obtaining an experimental result that is at least as extreme as the one that we have actually obtained. That probability plays a crucial role in frequentist statistical inferences. But if we take the word ‘extreme’ to mean ‘improbable’, then we can show that this type of inference can be very problematic. In this paper, I argue that it is a mistake to make such an interpretation. Under minimal assumptions about (...) the alternative hypothesis, I explain why ‘extreme’ means ‘outside the most precise predicted range of experimental outcomes for a given upper bound probability of error’. Doing so, I rebut recent formulations of recurrent criticisms against the frequentist approach in statistics and underscore the importance of random variables. (shrink)

The view that chances are relative frequencies of occurrence within actual, finite reference classes has long been written off. I argue that it ought to be reconsidered. Focusing on non-deterministic chance, I defend a version of finite frequentism in which reference classmates are required to have qualitatively identical pasts. While my analysis can evade or resist several standard objections, it has a counterintuitive consequence: non-trivial chances entail the existence of past light cones that are perfect intrinsic duplicates. In mitigation, I (...) argue that our scientific knowledge is consistent with the hypothesis that there are many such duplicates in the actual world. Moreover, my analysis has some striking advantages: it is simple, it is metaphysically undemanding, and it makes possible a satisfying explanation of the chance–credence connection. 1 Introduction2 Target3 Sketch and Skirmish4 Articulation5 Standard Worries5.1 Frequency tolerance5.2 Leibniz’s dictum5.3 Single case chance5.4 Missing values5.5 Explanation5.6 Counterfactual chances6 Chance and Credence6.1 An indefeasible indifference intuition6.2 Articulating the credence principle6.3 Appraising the credence principle7 Confirmation8 Laws9 Summing Up. (shrink)

This work has been selected by scholars as being culturally important, and is part of the knowledge base of civilization as we know it. This work was reproduced from the original artifact, and remains as true to the original work as possible. Therefore, you will see the original copyright references, library stamps (as most of these works have been housed in our most important libraries around the world), and other notations in the work.This work is in the public domain in (...) the United States of America, and possibly other nations. Within the United States, you may freely copy and distribute this work, as no entity (individual or corporate) has a copyright on the body of the work.As a reproduction of a historical artifact, this work may contain missing or blurred pages, poor pictures, errant marks, etc. Scholars believe, and we concur, that this work is important enough to be preserved, reproduced, and made generally available to the public. We appreciate your support of the preservation process, and thank you for being an important part of keeping this knowledge alive and relevant. (shrink)

We propose a new interpretation of objective deterministic chances in statistical physics based on physical computational complexity. This notion applies to a single physical system (be it an experimental set--up in the lab, or a subsystem of the universe), and quantifies (1) the difficulty to realize a physical state given another, (2) the 'distance' (in terms of physical resources) from a physical state to another, and (3) the size of the set of time--complexity functions that are compatible with the physical (...) resources required to reach a physical state from another. (shrink)

Statistical physicists assume a probability distribution over micro-states to explain thermodynamic behavior. The question of this paper is whether these probabilities are part of a best system and can thus be interpreted as Humean chances. I consider two Boltzmannian accounts of the Second Law, viz. a globalist and a localist one. In both cases, the probabilities fail to be chances because they have rivals that are roughly equally good. I conclude with the diagnosis that well-defined micro-probabilities under-estimate the robust character (...) of explanations in statistical physics. (shrink)

The idea that probability is a degree of rational belief seemed too vague for a foundation of a mathematical theory. It was certainly not obvious that degrees of rational belief had to be governed by the probability axioms as used by Laplace and other prestatistical probabilityst. The axioms seemed arbitrary in their interpretation. To eliminate the arbitrariness, the stat- isticians of the early 20th century drastically restricted the possible applications of the probability theory, by insisting that probabilities had to be (...) interpreted as relative frequencies, which obviously satisfied the probability axioms, and so the arbitrariness was removed. But the frequentist approach turned more subjective than the prestatistical approach, because the identifications of outcome spaces, the choices of test statistics, the declarations of what rejection regions are, the choices of null-hypothesis among alternatives, the contradictory choices between sizes and powers etc., depend on thoughts or even whims of the experimenter. Frequentists thus failed to solve the problems that motivated their approach, they even exacerbated them. The subjective Bayesianism of Ramsey and de Finetti did not solve the problems either. Finally Cox provided the missing foundation for probability as a degree of rational belief, which makes the Bayesian probability theory (which is based on this foundation) the best theory of probable inference we have. Hence, it is quite unbelievable that it is not even mentioned in recent philosophy textbooks devoted to the probable inference. The reason could be that it requires fairly sophisticated mathematics. But not even to mention it? We explain the history and prove Cox theorem in a novel way. (shrink)

The goal of this paper is to provide a detailed reading of John Venn's Logic of Chance as a work of logic or, more specifically, as a specific portion of the general system of so-called ‘material’ logic developed in his Principles of Empirical or Inductive Logic and to discuss it against the background of his Boolean-inspired views on the connection between logic and mathematics. It is by means of this situating of Venn 1866 [The Logic of Chance. An Essay on (...) the Foundations and Province of the Theory of Probability. With Especial Reference to Its Application to Moral and Social Science, London: Macmillan] within the entirety of his oeuvre that it becomes both possible to revisit and necessary to re-articulate its place in the history of the frequency interpretation of probability. For it is clear that if Venn's approach to logic not only allowed him to establish its foundations on the basis of a process of idealization and define it as consisting of so-called hypothetical infinite series, bu.. (shrink)

The goal of this paper is to correct a widespread misconception about the work of Robert Leslie Ellis and John Venn, namely that it can be considered as the ‘British empiricist’ reaction against the traditional theory of probability. It is argued, instead, that there was no unified ‘British school’ of frequentism during the nineteenth century. Where Ellis arrived at frequentism from a metaphysical idealist transformation of probability theory’s mathematical calculations, Venn did so on the basis of an empiricist critique of (...) its ‘inverse application’. (shrink)

At the heart of Drazen Prelec’s chapter is the distinction between outcome utility and diagnostic utility. There is a particular distinction in the literature on causal networks (Pearl 2000), namely the distinction between observing and intervening, that maps onto Prelec’s distinction between diagnostic and outcome utility. I will explore the connection between both frameworks.

I show that David Lewis’s principal principle is not preserved under Jeffrey conditionalization. Using this observation, I argue that Lewis’s reason for rejecting the desire as belief thesis and Adams’s thesis applies also to his own principal principle. 1 Introduction2 Adams’s Thesis, the Desire as Belief Thesis, and the Principal Principle3 Jeffrey Conditionalization4 The Principal Principles Not Preserved under Jeffrey Conditionalization5 Inadmissible Experiences.

The main objective of the paper is to propose a frequentist interpretation of probability in the context of model-based induction, anchored on the Strong Law of Large Numbers (SLLN) and justifiable on empirical grounds. It is argued that the prevailing views in philosophy of science concerning induction and the frequentist interpretation of probability are unduly influenced by enumerative induction, and the von Mises rendering, both of which are at odds with frequentist model-based induction that dominates current practice. The differences between (...) the two perspectives are brought out with a view to defend the model-based frequentist interpretation of probability against certain well-known charges, including [i] the circularity of its definition, [ii] its inability to assign ‘single event’ probabilities, and [iii] its reliance on ‘random samples’. It is argued that charges [i]–[ii] stem from misidentifying the frequentist ‘long-run’ with the von Mises collective. In contrast, the defining characteristic of the long-run metaphor associated with model-based induction is neither its temporal nor its physical dimension, but its repeatability (in principle); an attribute that renders it operational in practice. It is also argued that the notion of a statistical model can easily accommodate non-IID samples, rendering charge [iii] simply misinformed. (shrink)

The goal of this paper is to provide an extensive account of Robert Leslie Ellisʼs largely forgotten work on philosophy of science and probability theory. On the one hand, it is suggested that both his ‘idealist’ renovation of the Baconian theory of induction and a ‘realism’ vis-à-vis natural kinds were the result of a complex dialogue with the work of William Whewell. On the other hand, it is shown to what extent the combining of these two positions contributed to Ellisʼs (...) reformulation of the metaphysical foundations of traditional probability theory. This parallel is assessed with reference to the disagreement between Ellis and Whewell on the nature of (pure) mathematics and its relation to scientific knowledge. (shrink)

It is a commonplace that scientific inquiry makes extensive use of probabilities, many of which seem to be objective chances, describing features of reality that are independent of our minds. Such chances appear to have a number of paradoxical or puzzling features: they appear to be mind-independent facts, but they are intimately connected with rational psychology; they display a temporal asymmetry, but they are supposed to be grounded in physical laws that are time-symmetric; and chances are used to explain and (...) predict frequencies of events, although they cannot be reduced to those frequencies. This book offers an accessible and non-technical introduction to these and other puzzles. Toby Handfield engages with traditional metaphysics and philosophy of science, drawing upon recent work in the foundations of quantum mechanics and thermodynamics to provide a novel account of objective probability that is empirically informed without requiring specialist scientific knowledge. (shrink)

The most interesting and completely overlooked aspect of Ludwig von Mises’s theory of probability is the total absence of any explicit definition for probability in his theory. This paper examines Mises’s theory of probability in light of the fact that his theory possesses no definition for probability. It is argued, first, that Mises’s theory differs in important respects from his brother’s famous theory of probability. A defense of the subjective definition for probability is then provided, which is subsequently used to (...) critique Ludwig von Mises’s theory. It is argued that only the subjective definition for probability comports with Mises’s other philosophical positions. Since Mises did not provide an explicit definition for probability, it is suggested that he ought to have adopted a subjective definition. (shrink)

_Philosophy of Probability: Contemporary Readings_ is the first anthology to collect essential readings in this important area of philosophy. Featuring the work of leading philosophers in the field such as Carnap, Hájek, Jeffrey, Joyce, Lewis, Loewer, Popper, Ramsey, van Fraassen, von Mises, and many others, the book looks in depth at the following key topics: subjective probability and credence probability updating: conditionalization and reflection Bayesian confirmation theory classical, logical, and evidential probability frequentism physical probability: propensities and objective chances. The book (...) features a useful primer on the mathematics of probability, and each section includes an introduction by the editor, as well as a guide to further reading. A broad-ranging and highly accessible exploration of the subject, _Philosophy of Probability_ is ideal for any student of formal epistemology, philosophy of science, metaphysics, or philosophy of mathematics. (shrink)

In the face of continuing assumptions by many scientists and journal editors that p-values provide a gold standard for inference, counter warnings are published periodically. But the core problem is not with p-values, per se. A finding that “p-value is less than α” could merely signal that a critical value has been exceeded. The question is why, when estimating a parameter, we provide a range (a confidence interval), but when testing a hypothesis about a parameter (e.g. µ = x) we (...) proceed as if “=” entails exact equality of the parameter with x. That standard is hard to meet, and is not a standard expected for power calculations, where we are satisfied to reject a null hypothesis H0 if the result is merely “detectably” different from (exact) H0. This paper explores, with resampling (simulation) methods, the impacts on p-values, and alternatives, if the null hypothesis is defined as a thick or thin range of values. It also examines, empirically, the extent to which the p-value may or may not be a good predictor of the probability that H0 is true, given the distribution of the data. (shrink)

Statistical inference is often justified by long-run properties of the sampling distributions, such as the repeated sampling rationale. These are frequentist justifications of statistical inference. I argue, in line with existing philosophical literature, but against a widespread image in empirical science, that these justifications are flawed. Then I propose a novel interpretation of probability in statistics, the artefactual interpretation. I believe that this interpretation is able to bridge the gap between statistical probability calculations and rational decisions on the basis of (...) observed data. The artefactual interpretation is able to justify statistical inference without making any assumptions about probability in the material world. (shrink)

The economic paradigms of Ludwig von Mises on the one hand and of John Maynard Keynes on the other have been correctly recognized as antithetical at the theoretical level, and as antagonistic with respect to their practical and public policy implications. Characteristically they have also been vindicated by opposing sides of the political spectrum. Nevertheless the respective views of these authors with respect to the meaning and interpretation of probability exhibit a closer conceptual affinity than has been acknowledged in the (...) literature. In particular it is argued that in some relevant respects Ludwig von Mises´ interpretation of the concept of probability exhibits a closer affinity with the interpretation of probability developed by his opponent John Maynard Keynes than with the views on probability espoused by his brother Richard von Mises. Nevertheless there also exist significant differences between the views of Ludwig von Mises and those of John Maynard Keynes with respect to probability. One of these is highlighted more particularly: where John Maynard Keynes advocated a monist view of probability, Ludwig von Mises embraced a dualist view of probability, according to which the concept of probability has two different meanings each of which is valid in a particular area or context. It is concluded that both John Maynard Keynes and Ludwig von Mises presented highly nuanced views with respect to the meaning and interpretation of probability. (shrink)

In my recent article on these pages I argued that members of the Austrian School of economics have adopted and defended a faulty definition of probability. I argued that the definition of probability necessarily depends upon the nature of the world in which we live. I claimed that if the nature of the world is such that every event and phenomenon which occurs has a cause of some sort, then probability must be defined subjectively; that is, “as a measure of (...) our uncertainty about the likelihood of occurrence of some event or phenomenon, based upon evidence that need not derive solely from past frequencies of ‘collectives’ or ‘classes.’” I further claimed that the nature of the world is indeed such that all events and phenomena have prior causes, and that this fact compels us to adopt a subjective definition of probability.David Howden has recently published what he claims is a refutation of my argument in his article “Single Trial Probability Applications: Can Subjectivity Evade Frequency Limitations” . Unfortunately, Mr. Howden appears to not have understood my argument, and his purported refutation of my subjective definition consequently amounts to nothing more than a concatenation of confused and fallacious ideas that are completely irrelevant to my argument. David Howden has thus failed in his attempt to vindicate Richard von Mises’s definition of probability. (shrink)

Both Ludwig von Mises and Richard von Mises claimed that numerical probability could not be legitimately applied to singular cases. This paper challenges this aspect of the von Mises brothers’ theory of probability. It is argued that their denial that numerical probability could be applied to singular cases was based solely upon Richard von Mises’ exceptionally restrictive definition of probability. This paper challenges Richard von Mises’ definition of probability by arguing that the definition of probability necessarily depends upon whether the (...) world is governed by time-invariant causal laws. It is argued that if the world is governed by time-invariant causal laws, a subjective definition of probability must be adopted. It is further argued that both the nature of human action and the relative frequency method for calculating numerical probabilities both presuppose that the world is indeed governed by time-invariant causal laws. It is finally argued that the subjective definition of probability undercuts the von Mises claim that numerical probability cannot legitimately be applied to singular, non-replicable cases. (shrink)

This is the sequel to my “Fifteen Arguments Against Finite Frequentism” ( Erkenntnis 1997), the second half of a long paper that attacks the two main forms of frequentism about probability. Hypothetical frequentism asserts: The probability of an attribute A in a reference class B is p iff the limit of the relative frequency of A ’s among the B ’s would be p if there were an infinite sequence of B ’s. I offer fifteen arguments against this analysis. I (...) consider various frequentist responses, which I argue ultimately fail. I end with a positive proposal of my own, ‘hyper-hypothetical frequentism’, which I argue avoids several of the problems with hypothetical frequentism. It identifies probability with relative frequency in a hyperfinite sequence of trials. However, I argue that this account also fails, and that the prospects for frequentism are dim. (shrink)

To what extent does the design of statistical experiments, in particular sequential trials, affect their interpretation? Should postexperimental decisions depend on the observed data alone, or should they account for the used stopping rule? Bayesians and frequentists are apparently deadlocked in their controversy over these questions. To resolve the deadlock, I suggest a three‐part strategy that combines conceptual, methodological, and decision‐theoretic arguments. This approach maintains the pre‐experimental relevance of experimental design and stopping rules but vindicates their evidential, postexperimental irrelevance. †To (...) contact the author, please write to: Tilburg Center for Logic and Philosophy of Science, Tilburg University, P.O. Box 90153, 5000 LE Tilburg, The Netherlands; e‐mail: [email protected]. (shrink)

Inductive logic generalizes the idea of logical entailment and provides standards for the evaluation of non-conclusive arguments. A main application of inductive logic is the generalization of observational data to theoretical models. In the empirical sciences, the mathematical theory of statistics addresses the same problem. This paper argues that there is no separable purely logical aspect of statistical inference in a variety of complex problems. Instead, statistical practice is often motivated by decision-theoretic considerations and resembles empirical science.

Reichenbach’s use of ‘posits’ to defend his frequentistic theory of probability has been criticized on the grounds that it makes unfalsifiable predictions. The justice of this criticism has blinded many to Reichenbach’s second use of a posit, one that can fruitfully be applied to current debates within epistemology. We show first that Reichenbach’s alternative type of posit creates a difficulty for epistemic foundationalists, and then that its use is equivalent to a particular kind of Jeffrey conditionalization. We conclude that, under (...) particular circumstances, Reichenbach’s approach and that of the Bayesians amount to the same thing, thereby presenting us with a new instance in which chance and credence coincide. (shrink)

After some general remarks about the interrelation between philosophical and statistical thinking, the discussion centres largely on significance tests. These are defined as the calculation of p-values rather than as formal procedures for ‘acceptance‘ and ‘rejection‘. A number of types of null hypothesis are described and a principle for evidential interpretation set out governing the implications of p- values in the specific circumstances of each application, as contrasted with a long-run interpretation. A number of more complicated situ- ations are discussed (...) in which modification of the simple p-value may be essential. (shrink)

Probability theory is important not least because of its relevance for decision making, which also means: its relevance for the single case. The frequency theory of probability on its own is irrelevant in the single case. However, Howson and Urbach argue that Bayesianism can solve the frequentist's problem: frequentist-probability information is relevant to Bayesians. The present paper shows that Howson and Urbach's solution cannot work, and indeed that no Bayesian solution can work. There is no way to make frequentist probability (...) relevant. (shrink)