Frontiers in Psychology 12 (2021)
Authors |
|
Abstract |
Questionable research practices are a well-recognized problem in psychology. Coding bias, or the tendency of review studies to disproportionately cite positive findings from original research, has received comparatively little attention. Coding bias is more likely to occur when original research, such as neuroimaging, includes large numbers of effects, and is most concerning in applied contexts. We evaluated coding bias in reviews of structural magnetic resonance imaging studies of PCL-R psychopathy. We used PRISMA guidelines to locate all relevant original sMRI studies and reviews. The proportion of null-findings cited in reviews was significantly lower than those reported in original research, indicating coding bias. Coding bias was not affected by publication date or review design. Reviews recommending forensic applications—such as treatment amenability or reduced criminal responsibility—were no more accurate than purely theoretical reviews. Coding bias may have contributed to a perception that structural brain abnormalities in psychopaths are more consistent than they actually are, and by extension that sMRI findings are suitable for forensic application. We discuss possible sources for the pervasive coding bias we observed, and we provide recommendations to counteract this bias in review studies. Until coding bias is addressed, we argue that this literature should not inform conclusions about psychopaths' neurobiology, especially in forensic contexts.
|
Keywords | No keywords specified (fix it) |
Categories | (categorize this paper) |
DOI | 10.3389/fpsyg.2021.654336 |
Options |
![]() ![]() ![]() ![]() |
Download options
References found in this work BETA
Publication and Other Reporting Biases in Cognitive Sciences: Detection, Prevalence, and Prevention.John P. A. Ioannidis, Marcus R. Munafò, Paolo Fusar-Poli, Brian A. Nosek & Sean P. David - 2014 - Trends in Cognitive Sciences 18 (5):235-241.
Neuroprediction, Violence, and the Law: Setting the Stage.Thomas Nadelhoffer, Stephanos Bibas, Scott Grafton, Kent A. Kiehl, Andrew Mansfield, Walter Sinnott-Armstrong & Michael Gazzaniga - 2012 - Neuroethics 5 (1):67-99.
The Psychopath Magnetized: Insights From Brain Imaging.Nathaniel E. Anderson & Kent A. Kiehl - 2012 - Trends in Cognitive Sciences 16 (1):52-60.
Risk Assessment Tools in Criminal Justice and Forensic Psychiatry: The Need for Better Data.Thomas Douglas, Jonathan Pugh, Illina Singh, Julian Savulescu & Seena Fazel - 2017 - European Psychiatry 42:134-137.
Predicting Violent Behavior: What Can Neuroscience Add?Russell A. Poldrack, John Monahan, Peter B. Imrey, Valerie Reyna, Marcus E. Raichle, David Faigman & Joshua W. Buckholtz - 2018 - Trends in Cognitive Sciences 22 (2):111-123.
View all 13 references / Add more references
Citations of this work BETA
No citations found.
Similar books and articles
Publication Bias: The Achilles' Heel of Systematic Reviews?Carole J. Torgerson - 2006 - British Journal of Educational Studies 54 (1):89 - 102.
Publication Bias: The Achilles’ Heel of Systematic Reviews?Carole J. Torgerson - 2006 - British Journal of Educational Studies 54 (1):89-102.
The “Bias” Bias in Social Psychology: Adaptive When and How?James Friedrich - 2004 - Behavioral and Brain Sciences 27 (3):335-336.
A Plea for Minimally Biased Naturalistic Philosophy.Andrea Polonioli - 2019 - Synthese 196 (9):3841-3867.
Bias in Peer Review.Carole J. Lee, Cassidy R. Sugimoto, Guo Zhang & Blaise Cronin - 2013 - Journal of the American Society for Information Science and Technology 64 (1):2-17.
The Origin of the Coding Metaphor in Neuroscience.Justin Garson - 2019 - Behavioral and Brain Sciences 42.
Evidence and Bias.Nick Hughes - forthcoming - In Clayton Littlejohn & Maria Lasonen Aarnio (eds.), Routledge Handbook of the Philosophy of Evidence.
Bias and Perception.Susanna Siegel - 2020 - In Erin Beeghly & Alex Madva (eds.), An Introduction to Implicit Bias: Knowledge, Justice, and the Social Mind. Routledge. pp. 99-115.
A Spatial Coding Analysis of the a-Not-B Error: What IS “Location at A”?Nora S. Newcombe - 2001 - Behavioral and Brain Sciences 24 (1):57-58.
Can UK NHS Research Ethics Committees Effectively Monitor Publication and Outcome Reporting Bias?Rasheda Begum & Simon Kolstoe - 2015 - BMC Medical Ethics 16 (1):1-5.
Implicit Bias and Philosophy, Volumes 1 and 2: Metaphysics and Epistemology.Michael S. Brownstein & Jennifer Mather Saul (eds.) - 2016 - Oxford University Press UK.
The Heterogeneity of Implicit Bias.Jules Holroyd & Joseph Sweetman - forthcoming - In Michael Brownstein & Jennifer Saul (eds.), Implicit Bias and Philosophy. New York, USA: Oxford University Press.
Analytics
Added to PP index
2021-04-12
Total views
88 ( #130,605 of 2,497,775 )
Recent downloads (6 months)
19 ( #44,098 of 2,497,775 )
2021-04-12
Total views
88 ( #130,605 of 2,497,775 )
Recent downloads (6 months)
19 ( #44,098 of 2,497,775 )
How can I increase my downloads?
Downloads