Characterizing Human Expertise Using Computational Metrics of Feature Diagnosticity in a Pattern Matching Task

Cognitive Science 41 (7):1716-1759 (2017)
  Copy   BIBTEX

Abstract

Forensic evidence often involves an evaluation of whether two impressions were made by the same source, such as whether a fingerprint from a crime scene has detail in agreement with an impression taken from a suspect. Human experts currently outperform computer-based comparison systems, but the strength of the evidence exemplified by the observed detail in agreement must be evaluated against the possibility that some other individual may have created the crime scene impression. Therefore, the strongest evidence comes from features in agreement that are also not shared with other impressions from other individuals. We characterize the nature of human expertise by applying two extant metrics to the images used in a fingerprint recognition task and use eye gaze data from experts to both tune and validate the models. The Attention via Information Maximization model quantifies the rarity of regions in the fingerprints to determine diagnosticity for purposes of excluding alternative sources. The CoVar model captures relationships between low-level features, mimicking properties of the early visual system. Both models produced classification and generalization performance in the 75%–80% range when classifying where experts tend to look. A validation study using regions identified by the AIM model as diagnostic demonstrates that human experts perform better when given regions of high diagnosticity. The computational nature of the metrics may help guard against wrongful convictions, as well as provide a quantitative measure of the strength of evidence in casework.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 91,386

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

What is an expert?Bruce D. Weinstein - 1993 - Theoretical Medicine and Bioethics 14 (1).
Intuition Fail: Philosophical Activity and the Limits of Expertise.Wesley Buckwalter - 2016 - Philosophy and Phenomenological Research 92 (2):378-410.
Philosophical and Psychological Accounts of Expertise and Experts.Matt Stichter - 2015 - Humana.Mente - Journal of Philosophical Studies 28:105-128.
Parts, features, and expertise.James Tanaka - 1998 - Behavioral and Brain Sciences 21 (1):37-38.
The possibility of ethical expertise.Bruce D. Weinstein - 1994 - Theoretical Medicine and Bioethics 15 (1):1-187.
Face Perception and Perceptual Expertise in Adult and Developmental Populations.Lisa Scott - 2011 - In Andy Calder, Gillian Rhodes, Mark Johnson & Jim Haxby (eds.), Oxford Handbook of Face Perception. Oxford University Press. pp. 195.
Three dimensions of expertise.Harry Collins - 2013 - Phenomenology and the Cognitive Sciences 12 (2):253-273.

Analytics

Added to PP
2016-11-10

Downloads
12 (#1,058,801)

6 months
3 (#992,474)

Historical graph of downloads
How can I increase my downloads?

Author's Profile

Chen Yu
NanJing University

References found in this work

A Mathematical Theory of Communication.Claude Elwood Shannon - 1948 - Bell System Technical Journal 27 (April 1924):379–423.
The base-rate fallacy in probability judgments.Maya Bar-Hillel - 1980 - Acta Psychologica 44 (3):211-233.
Perception below the Objective Threshold?Mark Van Selst & Philip M. Merikle - 1993 - Consciousness and Cognition 2 (3):194-203.
Computational modelling of visual attention.L. Itti & C. Koch - 2001 - Nature Reviews Neuroscience 2 (3):194-203.

View all 6 references / Add more references