Moral zombies: why algorithms are not moral agents

AI and Society 36 (2):487-497 (2021)
  Copy   BIBTEX

Abstract

In philosophy of mind, zombies are imaginary creatures that are exact physical duplicates of conscious subjects but for whom there is no first-personal experience. Zombies are meant to show that physicalism—the theory that the universe is made up entirely out of physical components—is false. In this paper, I apply the zombie thought experiment to the realm of morality to assess whether moral agency is something independent from sentience. Algorithms, I argue, are a kind of functional moral zombie, such that thinking about the latter can help us better understand and regulate the former. I contend that the main reason why algorithms can be neither autonomous nor accountable is that they lack sentience. Moral zombies and algorithms are incoherent as moral agents because they lack the necessary moral understanding to be morally responsible. To understand what it means to inflict pain on someone, it is necessary to have experiential knowledge of pain. At most, for an algorithm that feels nothing, ‘values’ will be items on a list, possibly prioritised in a certain way according to a number that represents weightiness. But entities that do not feel cannot value, and beings that do not value cannot act for moral reasons.

Other Versions

No versions found

Analytics

Added to PP
2021-04-16

Downloads
1,180 (#17,055)

6 months
181 (#21,422)

Historical graph of downloads
How can I increase my downloads?

Author's Profile

Carissa Véliz
University of Oxford

Citations of this work

The Curious Case of Uncurious Creation.Lindsay Brainard - forthcoming - Inquiry: An Interdisciplinary Journal of Philosophy.
Artificial agents: responsibility & control gaps.Herman Veluwenkamp & Frank Hindriks - forthcoming - Inquiry: An Interdisciplinary Journal of Philosophy.

View all 49 citations / Add more citations

References found in this work

Groundwork for the metaphysics of morals.Immanuel Kant - 1785 - New York: Oxford University Press. Edited by Thomas E. Hill & Arnulf Zweig.
Minds, brains, and programs.John Searle - 1980 - Behavioral and Brain Sciences 3 (3):417-57.
Unprincipled virtue: an inquiry into moral agency.Nomy Arpaly - 2003 - New York: Oxford University Press.
Welcoming Robots into the Moral Circle: A Defence of Ethical Behaviourism.John Danaher - 2020 - Science and Engineering Ethics 26 (4):2023-2049.

View all 31 references / Add more references