Performance vs. competence in human–machine comparisons

Proceedings of the National Academy of Sciences 41 (2020)
  Copy   BIBTEX

Abstract

Does the human mind resemble the machines that can behave like it? Biologically inspired machine-learning systems approach “human-level” accuracy in an astounding variety of domains, and even predict human brain activity—raising the exciting possibility that such systems represent the world like we do. However, even seemingly intelligent machines fail in strange and “unhumanlike” ways, threatening their status as models of our minds. How can we know when human–machine behavioral differences reflect deep disparities in their underlying capacities, vs. when such failures are only superficial or peripheral? This article draws on a foundational insight from cognitive science—the distinction between performance and competence—to encourage “species-fair” comparisons between humans and machines. The performance/competence distinction urges us to consider whether the failure of a system to behave as ideally hypothesized, or the failure of one creature to behave like another, arises not because the system lacks the relevant knowledge or internal capacities (“competence”), but instead because of superficial constraints on demonstrating that knowledge (“performance”). I argue that this distinction has been neglected by research comparing human and machine behavior, and that it should be essential to any such comparison. Focusing on the domain of image classification, I identify three factors contributing to the species-fairness of human–machine comparisons, extracted from recent work that equates such constraints. Species-fair comparisons level the playing field between natural and artificial intelligence, so that we can separate more superficial differences from those that may be deep and enduring.

Links

PhilArchive

External links

  • This entry has no external links. Add one.
Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Bringing up Turing's 'Child-Machine'.Susan G. Sterrett - 2012 - In S. Barry Cooper (ed.), How the World Computes. pp. 703--713.
Emotion, Cognition and Artificial Intelligence.Jason Megill - 2014 - Minds and Machines 24 (2):189-199.
Tractable competence.Marcello Frixione - 2001 - Minds and Machines 11 (3):379-397.

Analytics

Added to PP
2020-10-15

Downloads
1,026 (#11,796)

6 months
155 (#16,870)

Historical graph of downloads
How can I increase my downloads?

Author's Profile

Chaz Firestone
Johns Hopkins University

References found in this work

No references found.

Add more references