Sample representation in the social sciences

Synthese (10):9097-9115 (2021)
  Copy   BIBTEX

Abstract

The social sciences face a problem of sample non-representation, where the majority of samples consist of undergraduate students from Euro-American institutions. The problem has been identified for decades with little trend of improvement. In this paper, I trace the history of sampling theory. The dominant framework, called the design-based approach, takes random sampling as the gold standard. The idea is that a sampling procedure that is maximally uninformative prevents samplers from introducing arbitrary bias, thus preserving sample representation. I show how this framework, while good in theory, faces many challenges in application. Instead, I advocate for an alternative framework, called the model-based approach to sampling, where representative samples are those balanced in composition, however they were drawn. I argue that the model-based framework is more appropriate in the social sciences because it allows for systematic assessment of imperfect samples and methodical improvement in resource-limited scientific contexts. I end with practical proposals of improving sample quality in the social sciences.

Similar books and articles

Surface Noise.Zed Adams - 2018 - British Journal of Aesthetics 58 (3):255-270.
For Science in the Social Sciences. [REVIEW]Fay Brian - 2006 - Philosophy of the Social Sciences 36 (2):227-240.

Analytics

Added to PP
2020-03-20

Downloads
1,224 (#9,491)

6 months
461 (#3,440)

Historical graph of downloads
How can I increase my downloads?

Author's Profile

Kino Zhao
Simon Fraser University

Citations of this work

When is an Ensemble like a Sample?Corey Dethier - 2022 - Synthese 200 (52):1-22.
Calibrating statistical tools: Improving the measure of Humanity's influence on the climate.Corey Dethier - 2022 - Studies in History and Philosophy of Science Part A 94 (C):158-166.
Prior Information in Frequentist Research Designs: The Case of Neyman’s Sampling Theory.Adam P. Kubiak & Paweł Kawalec - 2022 - Journal for General Philosophy of Science / Zeitschrift für Allgemeine Wissenschaftstheorie 53 (4):381-402.

Add more citations