When should researchers cite study differences in response to a failure to replicate?

Biology and Philosophy 37 (5):1-17 (2022)
  Copy   BIBTEX

Abstract

Scientists often respond to failures to replicate by citing differences between the experimental components of an original study and those of its attempted replication. In this paper, we investigate these purported mismatch explanations. We assess a body of failures to replicate in neuroscience studies on spinal cord injury. We argue that a defensible mismatch explanation is one where a mismatch of components is a difference maker for a mismatch of outcomes, and the components are relevantly different in the follow-up study, given the scope of the original study. With this account, we argue that not all differences between studies are meaningful, even if they are difference makers. As our examples show, focusing only on these differences results in disregarding the representativeness of the original experiment’s components and the scope of its outcomes, undercutting other epistemic aims, such as translation, in the process.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 92,369

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Memory and problem solving: A failure to replicate.Morton W. Weir - 1968 - Journal of Experimental Psychology 78 (1):166.
The End of Mystery.Sam Baron & Mark Colyvan - 2019 - American Philosophical Quarterly 56 (3):247-264.
Failure to replicate mood-dependent retrieval.Gordon H. Bower & John D. Mayer - 1985 - Bulletin of the Psychonomic Society 23 (1):39-42.
Unconscious perception of meaning: A failure to replicate.Karen A. Nolan & Alfonso Caramazza - 1982 - Bulletin of the Psychonomic Society 20 (1):23-26.
A nonhypnotic failure to replicate mood-dependent recall.Timothy L. Johnson & Eric Klinger - 1988 - Bulletin of the Psychonomic Society 26 (3):191-194.

Analytics

Added to PP
2022-09-03

Downloads
16 (#912,482)

6 months
10 (#278,909)

Historical graph of downloads
How can I increase my downloads?

Author's Profile

David Colaço
Ludwig Maximilians Universität, München

Citations of this work

No citations found.

Add more citations

References found in this work

The generalizability crisis.Tal Yarkoni - 2022 - Behavioral and Brain Sciences 45:1-37.
What Is a Replication?Edouard Machery - 2020 - Philosophy of Science 87 (4):545-567.
Philosophy of science and the replicability crisis.Felipe Romero - 2019 - Philosophy Compass 14 (11):e12633.

View all 15 references / Add more references