Deepfake detection by human crowds, machines, and machine-informed crowds

Proceedings of the National Academy of Sciences 119 (1):e2110013119 (2022)
  Copy   BIBTEX

Abstract

The recent emergence of machine-manipulated media raises an important societal question: How can we know whether a video that we watch is real or fake? In two online studies with 15,016 participants, we present authentic videos and deepfakes and ask participants to identify which is which. We compare the performance of ordinary human observers with the leading computer vision deepfake detection model and find them similarly accurate, while making different kinds of mistakes. Together, participants with access to the model’s prediction are more accurate than either alone, but inaccurate model predictions often decrease participants’ accuracy. To probe the relative strengths and weaknesses of humans and machines as detectors of deepfakes, we examine human and machine performance across video-level features, and we evaluate the impact of preregistered randomized interventions on deepfake detection. We find that manipulations designed to disrupt visual processing of faces hinder human participants’ performance while mostly not affecting the model’s performance, suggesting a role for specialized cognitive capacities in explaining human deepfake detection performance.

Links

PhilArchive

External links

  • This entry has no external links. Add one.
Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

The Distinct Wrong of Deepfakes.Adrienne de Ruiter - 2021 - Philosophy and Technology 34 (4):1311-1332.
Artificial intelligence, deepfakes and a future of ectypes.Luciano Floridi - 2018 - Philosophy and Technology 31 (3):317-321.
The singularity: A philosophical analysis.David J. Chalmers - 2010 - Journal of Consciousness Studies 17 (9-10):9 - 10.
Can machines think?W. Mays - 1952 - Philosophy 27 (April):148-62.
Ethical Machines?Ariela Tubert - 2018 - Seattle University Law Review 41 (4).

Analytics

Added to PP
2022-01-08

Downloads
212 (#91,160)

6 months
87 (#47,572)

Historical graph of downloads
How can I increase my downloads?

Author's Profile

Chaz Firestone
Johns Hopkins University

References found in this work

No references found.

Add more references