Kerr coined the term ‘HARKing’ to refer to the practice of ‘hypothesizing after the results are known’. This questionable research practice has received increased attention in recent years because it is thought to have contributed to low replication rates in science. The present article discusses the concept of HARKing from a philosophical standpoint and then undertakes a critical review of Kerr’s twelve potential costs of HARKing. It is argued that these potential costs are either misconceived, misattributed to HARKing, lacking evidence, (...) or that they do not take into account pre- and post-publication peer review and public availability to research materials and data. It is concluded that it is premature to conclude that HARKing has led to low replication rates. (shrink)

A common intuition about evidence is that if data x have been used to construct a hypothesis H, then x should not be used again in support of H. It is no surprise that x fits H, if H was deliberately constructed to accord with x. The question of when and why we should avoid such “double-counting” continues to be debated in philosophy and statistics. It arises as a prohibition against data mining, hunting for significance, tuning on the signal, and (...) ad hoc hypotheses, and as a preference for predesignated hypotheses and “surprising” predictions. I have argued that it is the severity or probativeness of the test—or lack of it—that should determine whether a double-use of data is admissible. I examine a number of surprising ambiguities and unexpected facts that continue to bedevil this debate. (shrink)

The growing acceptance and success of experimental economics has increased the interest of researchers in tackling philosophical and methodological challenges to which their work increasingly gives rise. I sketch some general issues that call for the combined expertise of experimental economists and philosophers of science, of experiment, and of inductive‐statistical inference and modeling. †To contact the author, please write to: 235 Major Williams, Virginia Tech, Blacksburg, VA 24061‐0126; e‐mail: [email protected].

As a discipline of its own, the philosophy of science can be traced back to the founding of its academic journals, some of which go back to the first half of the twentieth century. While the discipline has been the object of many historical studies, notably focusing on specific schools or major figures of the field, little work has focused on the journals themselves. Here, we investigate contemporary philosophy of science by means of computational text-mining approaches: we apply topic-modeling algorithms (...) to eight major philosophy of science journals, from the 1930s up until 2017. Based on the full-text content of some 15,897 articles, we identified 25 research themes and 8 thematic clusters that show how the research agenda of the philosophy of science has changed in its content over the course of the last eight decades, up to the philosophy of science we now know. We also show how each one of the journals contributed in its own way to this thematic evolution. (shrink)

When can macroscopic data about a system be used to set parameters in a microfoundational simulation? We examine the epistemic viability of tweaking parameter values to generate a better fit between the outcome of a simulation and the available observational data. We restrict our focus to microfoundational simulations—those simulations that attempt to replicate the macrobehavior of a target system by modeling interactions between microentities. We argue that tweaking can be effective but that there are two central risks. First, tweaking risks (...) overfitting the simulation to the data and thus compromising predictive accuracy; and second, it risks compromising the microfoundationality of the simulation. We evaluate standard responses to tweaking and propose strategies to guard against these risks. (shrink)

"Partial realism" is a common position in the contemporary philosophy of science literature. It states that the "essential" elements of empirically successful scientific theories accurately represent corresponding features the world. This thesis makes several novel contributions related to this position. Firstly, it offers a new definition of the concept of “empirical success”, representing a principled merger between the use-novelty and unification accounts. Secondly, it provides a comparative critical analysis of various accounts of which elements are "essential" to the success of (...) a theory, including structural realism and the divide et impera strategy. A novel account of essentialness, entitled the “empirically successful sub-theory "account", is defended. Thirdly, it is argued that the realism/anti-realism debate should put to the side metaphysical questions and focus instead on partial realism's commitment to the continuity of science. Because this commitment lacks metaphysical implications, it is referred to as "deflationary realism". Anti-realists cannot reject deflationary realism as a matter of a priori principle; its overall viability can therefore only be assessed by a careful examination of the history of science. Finally, another consequence of partial realism, named "partial rationalism", is defended. Partial rationalism states that, in cases where several competing theories have been suggested, scientists are rational just in case they accept the essential elements of each of the scientific theories on offer. This novel position subverts the existing literature on scientific "revolutions", as it sometimes demands that scientists devise a synthesis between competing scientific theories, instead of "choosing" only one. The philosophical points defended in this thesis are illustrated and supported by case studies from the history of science, including Fresnel’s wave theory of light, the Copernican revolution, the "neo-Darwinian synthesis" in evolutionary biology, the "prion revolution" in molecular biology, the miasma theory of disease, and the chemical revolution. (shrink)