Inferring Expertise in Knowledge and Prediction Ranking Tasks

Topics in Cognitive Science 4 (1):151-163 (2012)
  Copy   BIBTEX

Abstract

We apply a cognitive modeling approach to the problem of measuring expertise on rank ordering problems. In these problems, people must order a set of items in terms of a given criterion (e.g., ordering American holidays through the calendar year). Using a cognitive model of behavior on this problem that allows for individual differences in knowledge, we are able to infer people's expertise directly from the rankings they provide. We show that our model-based measure of expertise outperforms self-report measures, taken both before and after completing the ordering of items, in terms of correlation with the actual accuracy of the answers. These results apply to six general knowledge tasks, like ordering American holidays, and two prediction tasks, involving sporting and television competitions. Based on these results, we discuss the potential and limitations of using cognitive models in assessing expertise

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 90,593

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Interactional expertise as a third kind of knowledge.Harry Collins - 2004 - Phenomenology and the Cognitive Sciences 3 (2):125-143.
Three dimensions of expertise.Harry Collins - 2013 - Phenomenology and the Cognitive Sciences 12 (2):253-273.
The trouble with Madeleine.Harry Collins - 2004 - Phenomenology and the Cognitive Sciences 3 (2):165-170.
The possibility of ethical expertise.Bruce D. Weinstein - 1994 - Theoretical Medicine and Bioethics 15 (1):1-187.
The nature and nurture of expertise: a fourth dimension. [REVIEW]Gregory J. Feist - 2013 - Phenomenology and the Cognitive Sciences 12 (2):275-288.
On interactional expertise: Pragmatic and ontological considerations.Evan Selinger & John Mix - 2004 - Phenomenology and the Cognitive Sciences 3 (2):145-163.

Analytics

Added to PP
2012-01-18

Downloads
206 (#89,497)

6 months
3 (#445,838)

Historical graph of downloads
How can I increase my downloads?

Citations of this work

Can you read my mindprint?Lisa S. Pearl & Igii Enverga - 2014 - Interaction Studies. Social Behaviour and Communication in Biological and Artificial Systemsinteraction Studies / Social Behaviour and Communication in Biological and Artificial Systemsinteraction Studies 15 (3):359-387.

Add more citations