Bibliometrics in Academic Recruitment: A Screening Tool Rather than a Game Changer

Minerva 59 (1):53-78 (2021)
  Copy   BIBTEX

Abstract

This paper investigates the use of metrics to recruit professors for academic positions. We analyzed confidential reports with candidate evaluations in economics, sociology, physics, and informatics at the University of Oslo between 2000 and 2017. These unique data enabled us to explore how metrics were applied in these evaluations in relation to other assessment criteria. Despite being important evaluation criteria, metrics were seldom the most salient criteria in candidate evaluations. Moreover, metrics were applied chiefly as a screening tool to decrease the number of eligible candidates and not as a replacement for peer review. Contrary to the literature suggesting an escalation of metrics, we foremost detected stable assessment practices with only a modestly increased reliance on metrics. In addition, the use of metrics proved strongly dependent on disciplines where the disciplines applied metrics corresponding to their evaluation cultures. These robust evaluation practices provide an empirical example of how core university processes are chiefly characterized by path-dependency mechanisms, and only moderately by isomorphism. Additionally, the disciplinary-dependent spread of metrics offers a theoretical illustration of how travelling standards such as metrics are not only diffused but rather translated to fit the local context, resulting in heterogeneity and context-dependent spread.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 92,497

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Use and misuse of metrics in research evaluation.Ronald N. Kostoff - 1997 - Science and Engineering Ethics 3 (2):109-120.
Social Media Metrics for New Research Evaluation.Paul Wouters, Zohreh Zahedi & Rodrigo Costas - 2019 - In Wolfgang Glänzel, Henk F. Moed, Ulrich Schmoch & Mike Thelwall (eds.), Springer Handbook of Science and Technology Indicators. Springer Verlag. pp. 687-713.
Scholarly Twitter Metrics.Stefanie Haustein - 2019 - In Wolfgang Glänzel, Henk F. Moed, Ulrich Schmoch & Mike Thelwall (eds.), Springer Handbook of Science and Technology Indicators. Springer Verlag. pp. 729-760.
On the definition and examples of Finsler metrics.Miguel Angel Javaloyes & Miguel Sanchez - 2014 - Annali della Scuola Normale Superiore di Pisa- Classe di Scienze 13 (3):813-858.
Info-Metrics for Modeling and Inference.Amos Golan - 2018 - Minds and Machines 28 (4):787-793.
Quantum Mechanics and the Metrics of General Relativity.Paul O’Hara - 2005 - Foundations of Physics 35 (9):1563-1584.

Analytics

Added to PP
2020-09-10

Downloads
40 (#401,794)

6 months
8 (#373,162)

Historical graph of downloads
How can I increase my downloads?