NIH Peer Review: Criterion Scores Completely Account for Racial Disparities in Overall Impact Scores

Science Advances 6 (23):DOI: 10.1126/sciadv.aaz4868 (2020)
  Copy   BIBTEX

Abstract

Previous research has found that funding disparities are driven by applications’ final impact scores and that only a portion of the black/white funding gap can be explained by bibliometrics and topic choice. Using National Institutes of Health R01 applications for council years 2014–2016, we examine assigned reviewers’ preliminary overall impact and criterion scores to evaluate whether racial disparities in impact scores can be explained by application and applicant characteristics. We hypothesize that differences in commensuration—the process of combining criterion scores into overall impact scores—disadvantage black applicants. Using multilevel models and matching on key variables including career stage, gender, and area of science, we find little evidence for racial disparities emerging in the process of combining preliminary criterion scores into preliminary overall impact scores. Instead, preliminary criterion scores fully account for racial disparities—yet do not explain all of the variability—in preliminary overall impact scores.

Other Versions

No versions found

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 96,326

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

The Necessity of Commensuration Bias in Grant Peer Review.Remco Heesen - 2021 - Ergo: An Open Access Journal of Philosophy 8 (39):423--443.
Black and Sleepless in a Nonideal World.Keisha Ray - 2021 - In Elizabeth Victor & Laura K. Guidry-Grimes (eds.), Applying Nonideal Theory to Bioethics: Living and Dying in a Nonideal World. New York: Springer. pp. 235-254.
Refinement: Measuring informativeness of ratings in the absence of a gold standard.Sheridan Grant, Marina Meilă, Elena Erosheva & Carole Lee - 2022 - British Journal of Mathematical and Statistical Psychology 75 (3):593-615.
Framing Black Infant and Maternal Mortality.Wangui Muigai - 2022 - Journal of Law, Medicine and Ethics 50 (1):85-91.

Analytics

Added to PP
2021-10-21

Downloads
9 (#1,476,144)

6 months
5 (#1,303,461)

Historical graph of downloads
How can I increase my downloads?

Author's Profile

Carole J. Lee
University of Washington

References found in this work

No references found.

Add more references