A Conceptual and Computational Model of Moral Decision Making in Human and Artificial Agents
Topics in Cognitive Science 2 (3):454-485 (2010)
Abstract
Recently, there has been a resurgence of interest in general, comprehensive models of human cognition. Such models aim to explain higher-order cognitive faculties, such as deliberation and planning. Given a computational representation, the validity of these models can be tested in computer simulations such as software agents or embodied robots. The push to implement computational models of this kind has created the field of artificial general intelligence (AGI). Moral decision making is arguably one of the most challenging tasks for computational approaches to higher-order cognition. The need for increasingly autonomous artificial agents to factor moral considerations into their choices and actions has given rise to another new field of inquiry variously known as Machine Morality, Machine Ethics, Roboethics, or Friendly AI. In this study, we discuss how LIDA, an AGI model of human cognition, can be adapted to model both affective and rational features of moral decision making. Using the LIDA model, we will demonstrate how moral decisions can be made in many domains using the same mechanisms that enable general decision making. Comprehensive models of human cognition typically aim for compatibility with recent research in the cognitive and neural sciences. Global workspace theory, proposed by the neuropsychologist Bernard Baars (1988), is a highly regarded model of human cognition that is currently being computationally instantiated in several software implementations. LIDA (Franklin, Baars, Ramamurthy, & Ventura, 2005) is one such computational implementation. LIDA is both a set of computational tools and an underlying model of human cognition, which provides mechanisms that are capable of explaining how an agent’s selection of its next action arises from bottom-up collection of sensory data and top-down processes for making sense of its current situation. We will describe how the LIDA model helps integrate emotions into the human decision-making process, and we will elucidate a process whereby an agent can work through an ethical problem to reach a solution that takes account of ethically relevant factors.Author Profiles
DOI
10.1111/j.1756-8765.2010.01095.x
My notes
Similar books and articles
Confirmation and the computational paradigm, or, why do you think they call it artificial intelligence?David J. Buller - 1993 - Minds and Machines 3 (2):155-81.
Machine morality: bottom-up and top-down approaches for modelling human moral faculties. [REVIEW]Wendell Wallach, Colin Allen & Iva Smit - 2008 - AI and Society 22 (4):565-582.
Manufacturing Morality A general theory of moral agency grounding computational implementations: the ACTWith model.Jeffrey White - 2013 - In Floares (ed.), Computational Intelligence. Nova Publications. pp. 1-65.
understanding and augmenting human morality: the actwith model of conscience.Jeffrey White - 2009 - In L. Magnani (ed.), computational intelligence.
A test of a person -- issue contingent model of ethical decision making in organizations.Susan J. Harrington - 1997 - Journal of Business Ethics 16 (4):363-375.
An integrated model for ethical decisions in marketing research.Naresh K. Malhotra & Gina L. Miller - 1998 - Journal of Business Ethics 17 (3):263-280.
Thinking and feeling: Moral deliberation in a dual-process framework.Jillian Craigie - 2011 - Philosophical Psychology 24 (1):53-71.
Consciousness is computational: The Lida model of global workspace theory.Bernard J. Baars & Stan Franklin - 2009 - International Journal of Machine Consciousness 1 (1):23-32.
Robot minds and human ethics: the need for a comprehensive model of moral decision making. [REVIEW]Wendell Wallach - 2010 - Ethics and Information Technology 12 (3):243-250.
Analytics
Added to PP
2010-08-11
Downloads
209 (#61,419)
6 months
2 (#302,213)
2010-08-11
Downloads
209 (#61,419)
6 months
2 (#302,213)
Historical graph of downloads
Author Profiles
Citations of this work
Artificial Moral Agents: A Survey of the Current Status. [REVIEW]José-Antonio Cervantes, Sonia López, Luis-Felipe Rodríguez, Salvador Cervantes, Francisco Cervantes & Félix Ramos - 2020 - Science and Engineering Ethics 26 (2):501-532.
Moral Status and Intelligent Robots.John-Stewart Gordon & David J. Gunkel - 2022 - Southern Journal of Philosophy 60 (1):88-117.
People are averse to machines making moral decisions.Yochanan E. Bigman & Kurt Gray - 2018 - Cognition 181 (C):21-34.
Artificial Moral Agents Within an Ethos of AI4SG.Bongani Andy Mabaso - 2021 - Philosophy and Technology 34 (1):7-21.
Robot minds and human ethics: the need for a comprehensive model of moral decision making. [REVIEW]Wendell Wallach - 2010 - Ethics and Information Technology 12 (3):243-250.
References found in this work
The Ecological Approach to Visual Perception: Classic Edition.James J. Gibson - 1979 - Houghton Mifflin.