Generalization Bias in Science

Cognitive Science 46 (9):e13188 (2022)
  Copy   BIBTEX

Abstract

Many scientists routinely generalize from study samples to larger populations. It is commonly assumed that this cognitive process of scientific induction is a voluntary inference in which researchers assess the generalizability of their data and then draw conclusions accordingly. We challenge this view and argue for a novel account. The account describes scientific induction as involving by default a generalization bias that operates automatically and frequently leads researchers to unintentionally generalize their findings without sufficient evidence. The result is unwarranted, overgeneralized conclusions. We support this account of scientific induction by integrating a range of disparate findings from across the cognitive sciences that have until now not been connected to research on the nature of scientific induction. The view that scientific induction involves by default a generalization bias calls for a revision of the current thinking about scientific induction and highlights an overlooked cause of the replication crisis in the sciences. Commonly proposed interventions to tackle scientific overgeneralizations that may feed into this crisis need to be supplemented with cognitive debiasing strategies against generalization bias to most effectively improve science.

Similar books and articles

Generalization of positive and negative response biases.Michel Hersen - 1966 - Journal of Experimental Psychology 72 (6):834.
Two grades of evidential bias.Paul M. Churchland - 1975 - Philosophy of Science 42 (3):250-259.
Commensuration Bias in Peer Review.Carole J. Lee - 2015 - Philosophy of Science 82 (5):1272-1283,.
Evidence and Bias.Nick Hughes - 2019 - In Maria Lasonen-Aarnio & Clayton Littlejohn (eds.), The Routledge Handbook of the Philosophy of Evidence. Routledge.
Illegitimate Values, Confirmation Bias, and Mandevillian Cognition in Science.Uwe Peters - 2021 - British Journal for the Philosophy of Science 72 (4):1061-1081.
Mapping the Deep Blue Oceans.Rasmus Grønfeldt Winther - 2019 - In Timothy Tambassi (ed.), The Philosophy of GIS. pp. 99-123.
Wishful Thinking and Values in Science.Daniel Steel - 2018 - Philosophy of Science 85 (5):895-905.

Analytics

Added to PP
2022-08-03

Downloads
874 (#15,822)

6 months
278 (#7,427)

Historical graph of downloads
How can I increase my downloads?

Author Profiles

References found in this work

The weirdest people in the world?Joseph Henrich, Steven J. Heine & Ara Norenzayan - 2010 - Behavioral and Brain Sciences 33 (2-3):61-83.
The Fate of Knowledge.Helen E. Longino - 2002 - Princeton University Press.
Dual-Process Theories of Higher Cognition Advancing the Debate.Jonathan Evans & Keith E. Stanovich - 2013 - Perspectives on Psychological Science 8 (3):223-241.

View all 33 references / Add more references