Re-Thinking Reproducibility as a Criterion for Research Quality

Research in the History of Economic Thought and Methodology 36 (B):129-146 (2018)
  Copy   BIBTEX

Abstract

A heated debate surrounds the significance of reproducibility as an indicator for research quality and reliability, with many commentators linking a "crisis of reproducibility" to the rise of fraudulent, careless and unreliable practices of knowledge production. Through the analysis of discourse and practices across research fields, I point out that reproducibility is not only interpreted in different ways, but also serves a variety of epistemic functions depending on the research at hand. Given such variation, I argue that the uncritical pursuit of reproducibility as an overarching epistemic value is misleading and potentially damaging to scientific advancement. Requirements for reproducibility, however they are interpreted, are one of many available means to secure reliable research outcomes. Furthermore, there are cases where the focus on enhancing reproducibility turns out not to foster high-quality research. Scientific communities and Open Science advocates should learn from inferential reasoning from irreproducible data, and promote incentives for all researchers to explicitly and publicly discuss their methodological commitments, the ways in which they learn from mistakes and problems in everyday practice, and the strategies they use to choose which research component of any project needs to be preserved in the long term, and how.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 91,672

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Opinion: Reproducibility failures are essential to scientific inquiry.A. David Redish, Erich Kummerfeld, Rebecca Morris & Alan Love - 2018 - Proceedings of the National Academy of Sciences 115 (20):5042-5046.
Reproducibility as a Methodological Imperative in Experimental Research.Michael J. Hones - 1990 - PSA: Proceedings of the Biennial Meeting of the Philosophy of Science Association 1990:585 - 599.
Ethical and Legal Implications of the Methodological Crisis in Neuroimaging.Philipp Kellmeyer - 2017 - Cambridge Quarterly of Healthcare Ethics 26 (4):530-554.
Methodology and Scientific Competition.Max Albert - 2011 - Episteme 8 (2):165-183.
The concept of quality in clinical research.Dorota Śwituła - 2006 - Science and Engineering Ethics 12 (1):147-156.
Problems of reproducibility in complex mind-matter systems.Harald Atmanspacher - 2003 - Journal of Scientific Exploration 17 (2):243-270.
Experimental Reproducibility and the Experimenters' Regress.Hans Radder - 1992 - PSA: Proceedings of the Biennial Meeting of the Philosophy of Science Association 1992:63 - 73.

Analytics

Added to PP
2018-07-18

Downloads
110 (#160,100)

6 months
22 (#121,826)

Historical graph of downloads
How can I increase my downloads?

Author's Profile

Sabina Leonelli
University of Exeter

Citations of this work

Philosophy of science and the replicability crisis.Felipe Romero - 2019 - Philosophy Compass 14 (11):e12633.
Why Replication is Overrated.Uljana Feest - 2019 - Philosophy of Science 86 (5):895-905.
The limits of replicability.Stephan Guttinger - 2020 - European Journal for Philosophy of Science 10 (2):1-17.
The role of replication in psychological science.Samuel C. Fletcher - 2021 - European Journal for Philosophy of Science 11 (1):1-19.

View all 23 citations / Add more citations

References found in this work

Representing and Intervening.Ian Hacking - 1983 - British Journal for the Philosophy of Science 35 (4):381-390.
Representing and Intervening.Ian Hacking - 1987 - Revue de Métaphysique et de Morale 92 (2):279-279.
The World in the Model: How Economists Work and Think.Mary S. Morgan - 2012 - Cambridge University Press: Cambridge.
The Neglect of Experiment.Allan Franklin - 1986 - Cambridge University Press.

View all 16 references / Add more references