The wisdom of collective grading and the effects of epistemic and semantic diversity

Theory and Decision 85 (1):99-116 (2018)
  Copy   BIBTEX


A computer simulation is used to study collective judgements that an expert panel reaches on the basis of qualitative probability judgements contributed by individual members. The simulated panel displays a strong and robust crowd wisdom effect. The panel's performance is better when members contribute precise probability estimates instead of qualitative judgements, but not by much. Surprisingly, it doesn't always hurt for panel members to interpret the probability expressions differently. Indeed, coordinating their understandings can be much worse.

Similar books and articles


Added to PP

730 (#24,610)

6 months
111 (#50,264)

Historical graph of downloads
How can I increase my downloads?

Author Profiles

Aidan Lyon
Leiden University
Michael Morreau
University of Tromsø

Citations of this work

No citations found.

Add more citations

References found in this work

Social Choice and Individual Values.Irving M. Copi - 1952 - Science and Society 16 (2):181-181.
Social Choice and Individual Values.Kenneth Joseph Arrow - 1951 - New York, NY, USA: Wiley: New York.
Social Choice Theory.Christian List - 2014 - In Edward N. Zalta (ed.), The Stanford Encyclopedia of Philosophy. Stanford, CA: The Metaphysics Research Lab.
Social Choice Theory.Christian List - 2013 - Stanford Encyclopedia of Philosophy.
Deliberating groups versus prediction markets (or Hayek's challenge to Habermas).Cass R. Sunstein - 2011 - In Alvin I. Goldman & Dennis Whitcomb (eds.), Social Epistemology: Essential Readings. New York: Oxford University Press. pp. 192-213.

View all 12 references / Add more references