While many philosophers of science have accorded special evidential significance to tests whose results are "novel facts", there continues to be disagreement over both the definition of novelty and why it should matter. The view of novelty favored by Giere, Lakatos, Worrall and many others is that of use-novelty: An accordance between evidence e and hypothesis h provides a genuine test of h only if e is not used in h's construction. I argue that what lies behind the intuition that (...) novelty matters is the deeper intuition that severe tests matter. I set out a criterion of severity akin to the notion of a test's power in Neyman-Pearson statistics. I argue that tests which are use-novel may fail to be severe, and tests that are severe may fail to be use-novel. I discuss the 1919 eclipse data as a severe test of Einstein's law of gravity. (shrink)

How to regard the weight we give to a proposition on the grounds of its being endorsed by an authority? I examine this question as it is raised within the epistemology of science, and I argue that “authority-based weight” should receive special handling, for the following reason. Our assessments of other scientists’ competence or authority are nearly always provisional, in the sense that to save time and money, they are not made nearly as carefully as they could be---indeed, they are (...) typically made on the basis of only a small portion of the available evidence. Consequently, we need to represent the authority-based elements of our epistemic attitudes in such a way as to allow the later revision of those elements, in case we decide in the light of new priorities that a more conscientious assessment is warranted. I look to the literature in confirmation theory, statistics, and economics for a semiformal model of this revision process, and make a particular proposal of my own. The discussion also casts some light on the question of why certain aspects of science’s epistemic state are not made public. (shrink)

Why are conditional degrees of belief in an observation E, given a statistical hypothesis H, aligned with the objective probabilities expressed by H? After showing that standard replies are not satisfactory, I develop a suppositional analysis of conditional degree of belief, transferring Ramsey’s classical proposal to statistical inference. The analysis saves the alignment, explains the role of chance-credence coordination, and rebuts the charge of arbitrary assessment of evidence in Bayesian inference. Finally, I explore the implications of this analysis for Bayesian (...) reasoning with idealized models in science. (shrink)

One of the most troubling and persistent challenges for Bayesian Confirmation Theory is the Problem of Old Evidence. The problem arises for anyone who models scientific reasoning by means of Bayesian Conditionalization. This article addresses the problem as follows: First, I clarify the nature and varieties of the POE and analyze various solution proposals in the literature. Second, I present a novel solution that combines previous attempts while making weaker and more plausible assumptions. Third and last, I summarize my findings (...) and put them into the context of the general debate about POE and Bayesian reasoning. (shrink)

The debate about the relative epistemic weights carried in favour of a theory by predictions of new phenomena as opposed to accommodations of already known phenomena has a long history. We readdress the issue through a detailed re-examination of a particular historical case that has often been discussed in connection with it—that of Mendeleev and the prediction by his periodic law of the three ‘new’ elements, gallium, scandium and germanium. We find little support for the standard story that these predictive (...) successes were outstandingly important in the success of Mendeleev's scheme. Accommodations played an equal role—notably that of argon, the first of the ‘noble gases’ to be discovered; and the methodological situation in this chemical example turns out to be in interesting ways different from that in other cases—invariably from physics—that have been discussed in this connection. The historical episode when accurately analysed provides support for a different account of the relative weight of prediction and accommodation—one that is further articulated here. (shrink)

The Problem of Old Evidence (POE) states that Bayesian confirmation theory cannot explain why a theory H can be confirmed by a piece of evidence E already known. Different dimensions of POE have been highlighted. Here, I consider the dynamic and static dimension. In the former, we want to explain how the discovery that H accounts for E confirms H. In the latter, we want to understand why E is and will be a reason to prefer H over its competitors. (...) The aim of the paper is twofold. Firstly, I stress that two recent solutions to the dynamic dimension, recently proposed by Eva and Hartmann, can be read in terms of Inference to the Best Explanation (IBE). On this base, I gauge the weaknesses and strengths of the two models. Namely, I show that the two authors endorse a particular IBE’s formulation, and that it is still unsure if it is the one descriptively used. Moreover, I contend that, while one condition of their first model is not expression of this formulation, the only condition of their second model is. Secondly, I focus on the static dimension of POE which, now, has to be expressed in IBE terms. To solve it, I rely on the counterfactual approach, and on a version of IBE in which explanatory considerations help to evaluate the terms in Bayes’ theorem. However, it turns out that the problems of the counterfactual approach recur even when it is used to solve the static POE in IBE terms. (shrink)

Kerr coined the term ‘HARKing’ to refer to the practice of ‘hypothesizing after the results are known’. This questionable research practice has received increased attention in recent years because it is thought to have contributed to low replication rates in science. The present article discusses the concept of HARKing from a philosophical standpoint and then undertakes a critical review of Kerr’s twelve potential costs of HARKing. It is argued that these potential costs are either misconceived, misattributed to HARKing, lacking evidence, (...) or that they do not take into account pre- and post-publication peer review and public availability to research materials and data. It is concluded that it is premature to conclude that HARKing has led to low replication rates. (shrink)

Preregistration has been proposed as a useful method for making a publicly verifiable distinction between confirmatory hypothesis tests, which involve planned tests of ante hoc hypotheses, and exploratory hypothesis tests, which involve unplanned tests of post hoc hypotheses. This distinction is thought to be important because it has been proposed that confirmatory hypothesis tests provide more compelling results (less uncertain, less tentative, less open to bias) than exploratory hypothesis tests. In this article, we challenge this proposition and argue that there (...) are several advantages of exploratory hypothesis tests that can make their results more compelling than those of confirmatory hypothesis tests. We also consider some potential disadvantages of exploratory hypothesis tests and conclude that their advantages can outweigh the disadvantages. We conclude that exploratory hypothesis tests avoid researcher commitment and researcher prophecy biases, reduce the probability of data fraud, are more appropriate in the context of unplanned deviations, facilitate inference to the best explanation, and allow peer reviewers to make additional contributions at the data analysis stage. In contrast, confirmatory hypothesis tests may lead to an inappropriate level of confidence in research conclusions, less appropriate analyses in the context of unplanned deviations, and greater bias and errors in theoretical inferences. (shrink)

Bayesian confirmation theory, as traditionally interpreted, treats the temporal relationship between the formulation of a hypothesis and the confirmation (or recognition) of evidence entailed by that hypothesis merely as a component of the psychology of discovery and acceptance of a hypothesis. The temporal order of these events is irrelevant to the logic of rational theory choice. A few years ago Richmond Campbell and Thomas Vinci offered a reinterpretation of Bayes' Theorem in defense of the view that the temporal relationship between (...) hypothesis and evidence really does matter. More specifically, they advocated the thesis that successful predictions implied by scientific hypothesis H will increase the degree of confirmation of H only if they are novel predictions in the following sense; Evidence E is heuristically novel with respect to hypothesis H if and only if H was not deliberately designed to explain E (if E has already been corroborated) or in anticipation of E (if E is regarded as likely to be corroborated at some future date). Campbell and Vinci argue that the traditional interpretation of Bayes' Theorem misconstrues the significance of predictive novelty by ignoring heuristic novelty. In this paper I review the formal component of their preferred interpretation and demonstrate that it fails to establish that heuristic novelty has any special effect on theory confirmation. That is, even on their revisionist interpretation, regardless of whether H was deliberately designed to explain known evidence E (or in anticipation of suspected E), or whether H was designed without any awareness of the entailment relationship between H and E, Bayes' Theorem will generate the same epistemic probability for hypothesis H. Cases where new evidence was not foreseen at the time a hypothesis first emerged do not carry any more epistemic weight than they would have if such evidence had been foreseen. * Research on this paper was supported by an NEH summer grant. My thanks also to Richmond Campbell and Thomas Vinci for their reply to my initial evaluation of their position (in private correspondence), which compelled me to reconsider their arguments more carefully. (shrink)

The fundamental constants that are involved in the laws of physics which describe our universe are finely-tuned for life, in the sense that if some of the constants had slightly different values life could not exist. Some people hold that this provides evidence for the existence of God. I will present a probabilistic version of this fine-tuning argument which is stronger than all other versions in the literature. Nevertheless, I will show that one can have reasonable opinions such that the (...) fine-tuning argument doesn’t lead to an increase in one’s probability for the existence of God. (shrink)

It is generally accepted among philosophers of science that hypothesis testing is a key methodological feature of science. As far as philosophical theories of confirmation are con...

If coherence is to have justificatory status, as some analytical philosophers think it has, it must be truth-conducive, if perhaps only under certain specific conditions. This paper is a critical discussion of some recent arguments that seek to show that under no reasonable conditions can coherence be truth-conducive. More specifically, it considers Bovens and Hartmann’s and Olsson’s “impossibility results,” which attempt to show that coherence cannot possibly be a truth-conducive property. We point to various ways in which the advocates of (...) a coherence theory of justification may attempt to divert the threat of these results. (shrink)

Confirmation is commonly identified with positive relevance, E being said to confirm H if and only if E increases the probability of H. Today, analyses of this general kind are usually Bayesian ones that take the relevant probabilities to be subjective. I argue that these subjective Bayesian analyses are irremediably flawed. In their place I propose a relevance analysis that makes confirmation objective and which, I show, avoids the flaws of the subjective analyses. What I am proposing is in some (...) ways a return to Carnap's conception of confirmation, though there are also important differences between my analysis and his. My analysis includes new accounts of what evidence is and of the indexicality of confirmation claims. Finally, I defend my analysis against Achinstein's criticisms of the relevance concept of confirmation. (shrink)

A standard problem in empirical inquiry is how to adjudicate between contending theories when they work from different fundamental assumptions. In the field of political sociology, several strategies are adopted, from metatheoretical and comparative historical approaches to the recent formal models of scientific growth proposed by Imre Lakatos and Larry Laudan. After considering the limitations of these approaches, I develop an alternative strategy—"second—order empiricism"—based on the idea that successor theories have an onus to explain the apparent success of their rivals, (...) not only their own and their rivals' anomalies. Such a strategy, I argue, underscores some of the most effective analysis and argument in political sociology, yet is obscured by the appeal to other methodologies. (shrink)

Support functions $s(h,e)=p(h\backslash e)-p(h)$ are widely used in discussion of explanation, causality and, recently, in connection with the possibility or otherwise of probabilistic induction. With this latter application in view, a rather complete analysis of the variety of support functions, their interrelationships and their "non-deductive" and "inductive" components is presented. With the restriction to two propositions, three variable probabilities are enough to discuss such problems. The analysis is illustrated by graphs, a Venn diagram and by using the Laplace Rule of (...) Succession as an illustrative example. It is concluded that within this framework one cannot prove or disprove the possibility of probabilistic induction. (shrink)

Evidence that confirms a scientific hypothesis is said to be ‘novel’ if it is not discovered until after the hypothesis isconstructed. The philosophical issues surrounding novel confirmation have been well summarized by Campbell and Vinci [1983]. They write that philosophers of science generally agree that when observational evidence supports a theory, the confirmation is much stronger when the evidence is ‘novel’... There are, nevertheless, reasons to be skeptical of this tradition... The notion of novel confirmation is beset with a theoretical (...) puzzle about how the degree of confirmation can change without any change in the evidence, hypothesis, or auxiliary assumptions... There have not yet appeared any obviously satisfactory solutions to these problems Much of the literature on novel confirmation relies on the Bayesian analysis of conditional probabilities. Let H represent a hypothesis, E an event that confirms the hypothesis, and B some relevant background information. Denote by Pr the conditional probability of x given y. There are various plausible measures of the degree of support that E lends to H. Among these are: Degree of support = Pr Degree of support = Pr – Pr Degree of support = Pr – Pr Degree of support = Pr – Pt In the work cited, Campbell and Vinci offer a somewhat more involved Bayesian interpretation. Formula is discussed by Gardner [1981] who points out that under this formulation there can be no role for novelty. 'The function Pr contains no third slot in which to insert a temporal relation between the invention of H and the inventor's learning E. Obviously, then, this relation could not possibly affect E's support of H.' Formula, on the other hand, suggests a role for novelty. Bayes's Theorem allows us to rewrite the formula as Degree of support = Pr x [Pr – 1] We can use 1/Pr as a measure of the novelty of E. Then shows that the degree of support increases with novelty of E. In the paper already cited, Campbell and Vinci discuss shortcomings of this analysis. Formula expresses an alternative offered by Howson [1984]. In that formula, Pr represents the probability of H assuming that only B – {E} is known. This allows for the possibility of non-novel facts generating support for hypotheses. Niiniluoto [1984] argues for a variant along the lines of, in which we account for the possibility that the theorist was unaware that his hypothesis entails E. One problem in deciding among these approaches is that the choice of a definition for the degree of support appears arbitrary. What kind of argument could justify the choice of one definition over another? It is our position that there can be no basis for addressing this question in the absence of an explicit model of the process by which hypotheses are generated. Only in the presence of such a model can the various conditional probabilities be given meaningful interpretations. We provide such models in Sections 1, 2 and 4. The simple model of Section 1, incorporating strong assumptions, yields the conclusion that novelty is irrelevant. When these assumptions are relaxed in the later sections, novelty becomes relevant for a variety of reasons. It is at least potentially the case that scientists have more information about their own abilities than is publicly available, and this information might influence their decisions about whether even to attempt novel prediction. If this is so, then it should be incorporated into the model of hypothesis generation. This requires an explicit discussion of how scientists respond to incentives and how the incentives themselves evolve, which in turn takes us into the realm of economic theory. We have addressed these issues in another paper, written for an audience of economists. The results of this research are summarized in Section 3. (shrink)

I maintain, in defending “thirdism,” that Sleeping Beauty should do Bayesian updating after assigning the “preliminary probability” 1/4 to the statement S: “Today is Tuesday and the coin flip is heads.” (This preliminary probability obtains relative to a specific proper subset I of her available information.) Pust objects that her preliminary probability for S is really zero, because she could not be in an epistemic situation in which S is true. I reply that the impossibility of being in such an (...) epistemic situation is irrelevant, because relative to I, statement S nonetheless has degree of evidential support 1/4. (shrink)

We present a new argument for the claim that in the Sleeping Beauty problem, the probability that the coin comes up heads is 1/3. Our argument depends on a principle for the updating of probabilities that we call ‘generalized conditionalization’, and on a species of generalized conditionalization we call ‘synchronic conditionalization on old information’. We set forth a rationale for the legitimacy of generalized conditionalization, and we explain why our new argument for thirdism is immune to two attacks that Pust (...) (Synthese 160:97–101, 2008) has leveled at other arguments for thirdism. (shrink)

There is good reason to believe that, if it can be decided at all, the realism debate must be decided on a posteriori grounds. But at least prima facie the prospects for an a posteriori resolution of the debate seem bleak, given that realists and antirealists disagree over two of the most fundamental questions pertaining to any kind of empirical research, to wit, what the range of accessible evidence is and what the methodological status of explanatory considerations is. The present (...) paper aims to show that, while the difficulties that face an empirical approach to the realism debate are not to be discounted, they are not insurmountable either. Specifically, it presents a broadly Bayesian strategy for resolving the debate that is capable of solving those difficulties. The strategy crucially involves answers to the aforementioned questions that diverge from both the standard realist and the standard antirealist answers, but that should appear more natural and plausible than those to realists and antirealists alike. (shrink)

External world skeptics are typically opposed to admitting as evidence anything that goes beyond the purely phenomenal, and equally typically, they disown the use of rules of inference that might enable one to move from premises about the phenomenal alone to a conclusion about the external world. This seems to bar any a posteriori resolution of the skepticism debate. This paper argues that the situation is not quite so hopeless, and that an a posteriori resolution of the debate becomes possible (...) once it is recognized that the skeptic holds overly defensive and ill-motivated positions vis-à-vis both evidence and inference, and that more reasonable ones are available. In stating these more reasonable positions, as well as in showing how they make possible an a posteriori resolution of the skepticism debate, the paper draws on the machinery of Bayesian epistemology. (shrink)

The quantitative problem of old evidence is the problem of how to measure the degree to which e confirms h for agent A at time t when A regards e as justified at t. Existing attempts to solve this problem have applied the e-difference approach, which compares A's probability for h at t with what probability A would assign h if A did not regard e as justified at t. The quantitative problem has been widely regarded as unsolvable primarily on (...) the grounds that the e-difference approach suffers from intractable problems. Various philosophers have proposed that 'Bayesianism' should be rejected as a research strategy in confirmation theory in part because of the unsolvability of this problem. I develop a version of the e-difference approach which overcomes these problems and possesses various advantages (but also certain limitations). I develop an alternative 'theistic' approach which handles many cases that my development of the e-difference approach does not handle. I conclude with an assessment of the significance of the quantitative problem for Bayesianism and argue that this problem is misunderstood in so far as it is regarded as unsolvable, and in so far as it is regarded as a problem only for Bayesians. (shrink)

I discuss a contemporary solution to the dynamic problem of old evidence (POE), as proposed by Sprenger. Sprenger’s solution combines the Garber–Jeffrey–Niiniluoto (GJN) approach with Howson’s suggestion of counterfactually removing the old evidence from scientists’ belief systems. I argue that in the dynamic POE, the challenge is to explain how an insight under beliefs in which the old evidence E is known increased the credence of a scientific hypothesis. Therefore, Sprenger’s counterfactual solution, in which E has been artificially removed, does (...) not resolve the problem. I consider several potential responses. (shrink)

"Partial realism" is a common position in the contemporary philosophy of science literature. It states that the "essential" elements of empirically successful scientific theories accurately represent corresponding features the world. This thesis makes several novel contributions related to this position. Firstly, it offers a new definition of the concept of “empirical success”, representing a principled merger between the use-novelty and unification accounts. Secondly, it provides a comparative critical analysis of various accounts of which elements are "essential" to the success of (...) a theory, including structural realism and the divide et impera strategy. A novel account of essentialness, entitled the “empirically successful sub-theory "account", is defended. Thirdly, it is argued that the realism/anti-realism debate should put to the side metaphysical questions and focus instead on partial realism's commitment to the continuity of science. Because this commitment lacks metaphysical implications, it is referred to as "deflationary realism". Anti-realists cannot reject deflationary realism as a matter of a priori principle; its overall viability can therefore only be assessed by a careful examination of the history of science. Finally, another consequence of partial realism, named "partial rationalism", is defended. Partial rationalism states that, in cases where several competing theories have been suggested, scientists are rational just in case they accept the essential elements of each of the scientific theories on offer. This novel position subverts the existing literature on scientific "revolutions", as it sometimes demands that scientists devise a synthesis between competing scientific theories, instead of "choosing" only one. The philosophical points defended in this thesis are illustrated and supported by case studies from the history of science, including Fresnel’s wave theory of light, the Copernican revolution, the "neo-Darwinian synthesis" in evolutionary biology, the "prion revolution" in molecular biology, the miasma theory of disease, and the chemical revolution. (shrink)

It seems improbable that life would exist in a naturalistic universe. But if the universe were spatially infinite, then seemingly improbable events would be expected to happen; life would be expected to exist. It follows that the existence of life provides evidence that the universe is spatially infinite.