On Peer Review as the ‘Gold Standard’ in Measuring Research Excellence: From Secrecy to Openness?

Journal of Philosophy of Education 52 (3):379-396 (2018)
  Copy   BIBTEX

Abstract

As universities in the United Kingdom gear themselves up for the next Research Excellence Framework, REF2021, with peer review at its core, we critically re-visit the idea of peer review as a gold standard proxy for research excellence. We question the premise that anonymous peer review is a necessary and enabling condition for impartial, expert judgement. We argue that the intentions and supposed benefits underlying peer review and its associated concepts have become congealed in received discourse about research quality. Hence we explore the key conceptual issues raised by the nested assumptions and concepts that come into play in peer review as currently practised: primarily those of secrecy, anonymity, legitimacy, trust, impartiality and openness. After delineating the benefits attributed to peer review, we contrast its declared virtues with its problematic features. We locate peer review in an audit culture in which the reviewer is an academic labourer. Drawing on recent trends in moral and political philosophy, we question the usefulness of the ideal of impartiality when tied to secrecy. Then we raise more deliberative, intersubjective possibilities for a revised understanding of peer review in the context of an academic community. Finally, we suggest ways in which the academic community could pursue quality in research by recasting peer review to be less secret and more open.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 91,438

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Openness versus secrecy? Historical and historiographical remarks.Koen Vermeir - 2012 - British Journal for the History of Science 45 (2):165-188.
The principles and practices of Peer review.Ronald N. Kostoff - 1997 - Science and Engineering Ethics 3 (1):19-34.
The Inverse Relationship between Secrecy and Privacy.Julie Cohen - 2010 - Social Research: An International Quarterly 77 (2):883-898.
The Inverse Relationship between Secrecy and Privacy.Julie E. Cohen - 2010 - Social Research: An International Quarterly 77 (3):883-898.
The morality of scientific openness.Christian Munthe & Stellan Welin - 1996 - Science and Engineering Ethics 2 (4):411-428.
Advances in peer review research: an introduction.Arthur E. Stamps Iii - 1997 - Science and Engineering Ethics 3 (1):3-10.
Using a dialectical scientific brief in peer review.Arthur Stamps - 1997 - Science and Engineering Ethics 3 (1):85-98.
Bias in Peer Review.Carole J. Lee, Cassidy R. Sugimoto, Guo Zhang & Blaise Cronin - 2013 - Journal of the American Society for Information Science and Technology 64 (1):2-17.

Analytics

Added to PP
2018-11-16

Downloads
18 (#816,943)

6 months
4 (#793,623)

Historical graph of downloads
How can I increase my downloads?

Citations of this work

No citations found.

Add more citations

References found in this work

Communication and the Evolution of Society.Jürgen Habermas - 1983 - Philosophy and Rhetoric 16 (2):130-136.
The Audit Society: Rituals of Verification.Michael Power - 1999 - British Journal of Educational Studies 47 (1):92-94.
Survey article: The coming of age of deliberative democracy.J. Bohman - 1998 - Journal of Political Philosophy 6 (4):400–425.
Legitimacy and Economy in Deliberative Democracy.John S. Dryzek - 2001 - Political Theory 29 (5):651-669.

View all 8 references / Add more references