Computers are already approving financial transactions, controlling electrical supplies, and driving trains. Soon, service robots will be taking care of the elderly in their homes, and military robots will have their own targeting and firing protocols. Colin Allen and Wendell Wallach argue that as robots take on more and more responsibility, they must be programmed with moral decision-making abilities, for our own safety. Taking a fast paced tour through the latest thinking about philosophical ethics and artificial intelligence, the (...) authors argue that even if full moral agency for machines is a long way off, it is already necessary to start building a kind of functional morality, in which artificial moral agents have some basic ethical sensitivity. But the standard ethical theories don't seem adequate, and more socially engaged and engaging robots will be needed. As the authors show, the quest to build machines that are capable of telling right from wrong has begun. -/- Moral Machines is the first book to examine the challenge of building artificial moral agents, probing deeply into the nature of human decision making and ethics. (shrink)

Recently, there has been a resurgence of interest in general, comprehensive models of human cognition. Such models aim to explain higher-order cognitive faculties, such as deliberation and planning. Given a computational representation, the validity of these models can be tested in computer simulations such as software agents or embodied robots. The push to implement computational models of this kind has created the field of artificial general intelligence (AGI). Moral decision making is arguably one of the most challenging tasks for computational (...) approaches to higher-order cognition. The need for increasingly autonomous artificial agents to factor moral considerations into their choices and actions has given rise to another new field of inquiry variously known as Machine Morality, Machine Ethics, Roboethics, or Friendly AI. In this study, we discuss how LIDA, an AGI model of human cognition, can be adapted to model both affective and rational features of moral decision making. Using the LIDA model, we will demonstrate how moral decisions can be made in many domains using the same mechanisms that enable general decision making. Comprehensive models of human cognition typically aim for compatibility with recent research in the cognitive and neural sciences. Global workspace theory, proposed by the neuropsychologist Bernard Baars (1988), is a highly regarded model of human cognition that is currently being computationally instantiated in several software implementations. LIDA (Franklin, Baars, Ramamurthy, & Ventura, 2005) is one such computational implementation. LIDA is both a set of computational tools and an underlying model of human cognition, which provides mechanisms that are capable of explaining how an agent’s selection of its next action arises from bottom-up collection of sensory data and top-down processes for making sense of its current situation. We will describe how the LIDA model helps integrate emotions into the human decision-making process, and we will elucidate a process whereby an agent can work through an ethical problem to reach a solution that takes account of ethically relevant factors. (shrink)

Building artificial moral agents (AMAs) underscores the fragmentary character of presently available models of human ethical behavior. It is a distinctly different enterprise from either the attempt by moral philosophers to illuminate the “ought” of ethics or the research by cognitive scientists directed at revealing the mechanisms that influence moral psychology, and yet it draws on both. Philosophers and cognitive scientists have tended to stress the importance of particular cognitive mechanisms, e.g., reasoning, moral sentiments, heuristics, intuitions, or a moral grammar, (...) in the making of moral decisions. However, assembling a system from the bottom-up which is capable of accommodating moral considerations draws attention to the importance of a much wider array of mechanisms in honing moral intelligence. Moral machines need not emulate human cognitive faculties in order to function satisfactorily in responding to morally significant situations. But working through methods for building AMAs will have a profound effect in deepening an appreciation for the many mechanisms that contribute to a moral acumen, and the manner in which these mechanisms work together. Building AMAs highlights the need for a comprehensive model of how humans arrive at satisfactory moral judgments. (shrink)

A principal goal of the discipline of artificial morality is to design artificial agents to act as if they are moral agents. Intermediate goals of artificial morality are directed at building into AI systems sensitivity to the values, ethics, and legality of activities. The development of an effective foundation for the field of artificial morality involves exploring the technological and philosophical issues involved in making computers into explicit moral reasoners. The goal of this paper is to discuss strategies for implementing (...) artificial morality and the differing criteria for success that are appropriate to different strategies. (shrink)

The development of autonomous, robotic weaponry is progressing rapidly. Many observers agree that banning the initiation of lethal activity by autonomous weapons is a worthy goal. Some disagree with this goal, on the grounds that robots may equal and exceed the ethical conduct of human soldiers on the battlefield. Those who seek arms-control agreements limiting the use of military robots face practical difficulties. One such difficulty concerns defining the notion of an autonomous action by a robot. Another challenge concerns how (...) to verify and monitor the capabilities of rapidly changing technologies. In this article we describe concepts from our previous work about autonomy and ethics for robots and apply them to military robots and robot arms control. We conclude with a proposal for a first step toward limiting the deployment of autonomous weapons capable of initiating lethal force. (shrink)

The challenge of designing computer systems and robots with the ability to make moral judgments is stepping out of science fiction and moving into the laboratory. Engineers and scholars, anticipating practical necessities, are writing articles, participating in conference workshops, and initiating a few experiments directed at substantiating rudimentary moral reasoning in hardware and software. The subject has been designated by several names, including machine ethics, machine morality, artificial morality, or computational morality. Most references to the challenge elucidate one facet or (...) another of what is a very rich topic. This paper will offer a brief overview of the many dimensions of this new field of inquiry. (shrink)

For many innovations, oversight fits nicely within existing governance mechanisms; nevertheless, others pose unique public health, environmental, and ethical challenges. Synthetic artemisinin, for example, has many precursors in laboratory‐developed drugs that emulate natural forms of the same drug. The policy challenges posed by synthetic artemisinin do not differ significantly in kind from other laboratory‐formulated drugs. Synthetic biofuels and gene drives, however, fit less clearly into existing governance structures. How many of the new categories of products require new forms of regulatory (...) oversight, or at least extensive forms of testing, remains unclear.Any effort to improve the governance of synthetic biology should start with a rich understanding of the different possible science‐policy interfaces that could help to inform governance. CBA falls into a subset of the overall range of possibilities, and which interface is appropriate may turn out to depend on context, on the demands of the decision at hand. In what follows, we lay out a typology of interfaces. After that, we turn to the question of how to draw upon the range of possible interfaces and effectively address the factual and moral complexities of emerging technologies. We propose a governance model built around structures that we call “governance coordinating committees.” GCCs are intended to be mechanisms for accommodating the complexities of innovations that have far‐ranging societal impacts. The production of biofuels, for example, could contaminate water supplies and have a destructive environmental impact if not managed correctly. The introduction of a gene drive could have economic and environmental impacts that are not restricted to one nation. Forging appropriate means for determining and evaluating those societal impacts, to the best of a corporation's, industry's, or government's ability, is central to responsible research and innovation. Public policy must be shaped in a manner that accommodates as many concerns as possible and minimizes risks. (shrink)

Emerging technologies present a challenging but fascinating set of ethical, legal and regulatory issues. The articles selected for this volume provide a broad overview of the most influential historical and current thinking in this area and show that existing frameworks are often inadequate to address new technologies - such as biotechnology, nanotechnology, synthetic biology and robotics - and innovative new models are needed. This collection brings together invaluable, innovative and often complementary approaches for overcoming the unique challenges of emerging technology (...) ethics and governance. (shrink)

The implementation of moral decision making abilities in artificial intelligence (AI) is a natural and necessary extension to the social mechanisms of autonomous software agents and robots. Engineers exploring design strategies for systems sensitive to moral considerations in their choices and actions will need to determine what role ethical theory should play in defining control architectures for such systems. The architectures for morally intelligent agents fall within two broad approaches: the top-down imposition of ethical theories, and the bottom-up building of (...) systems that aim at goals or standards which may or may not be specified in explicitly theoretical terms. In this paper we wish to provide some direction for continued research by outlining the value and limitations inherent in each of these approaches. (shrink)

Building artificial moral agents (AMAs) underscores the fragmentary character of presently available models of human ethical behavior. It is a distinctly different enterprise from either the attempt by moral philosophers to illuminate the “ought” of ethics or the research by cognitive scientists directed at revealing the mechanisms that influence moral psychology, and yet it draws on both. Philosophers and cognitive scientists have tended to stress the importance of particular cognitive mechanisms, e.g., reasoning, moral sentiments, heuristics, intuitions, or a moral grammar, (...) in the making of moral decisions. However, assembling a system from the bottom-up which is capable of accommodating moral considerations draws attention to the importance of a much wider array of mechanisms in honing moral intelligence. Moral machines need not emulate human cognitive faculties in order to function satisfactorily in responding to morally significant situations. But working through methods for building AMAs will have a profound effect in deepening an appreciation for the many mechanisms that contribute to a moral acumen, and the manner in which these mechanisms work together. Building AMAs highlights the need for a comprehensive model of how humans arrive at satisfactory moral judgments. (shrink)

The Rejected Body argues that feminist theorizing has been skewed toward non-disabled experience, and that the knowledge of people with disabilities must be integrated into feminist ethics, discussions of bodily life, and criticism of the cognitive and social authority of medicine. Among the topics it addresses are who should be identified as disabled; whether disability is biomedical, social or both; what causes disability and what could 'cure' it; and whether scientific efforts to eliminate disabling physical conditions are morally justified. (...) class='Hi'>Wendell provides a remarkable look at how cultural attitudes towards the body contribute to the stigma of disability and to widespread unwillingness to accept and provide for the body's inevitable weakness. (shrink)

This article examines the effect of material evidence upon historiographic hypotheses. Through a series of successive Bayesian conditionalizations, I analyze the extended competition among several hypotheses that offered different accounts of the transition between the Bronze Age and the Iron Age in Palestine and in particular to the “emergence of Israel”. The model reconstructs, with low sensitivity to initial assumptions, the actual outcomes including a complete alteration of the scientific consensus. Several known issues of Bayesian confirmation, including the problem of (...) old evidence, the introduction and confirmation of novel theories and the sensitivity of convergence to uncertain and disputed evidence are discussed in relation to the model’s result and the actual historical process. The most important result is that convergence of probabilities and of scientific opinion is indeed possible when advocates of rival hypotheses hold similar judgment about the factual content of evidence, even if they differ sharply in their historiographic interpretation. This speaks against the contention that understanding of present remains is so irrevocably biased by theoretical and cultural presumptions as to make an objective assessment impossible. (shrink)

: Chronic illness is a major cause of disability, especially in women. Therefore, any adequate feminist understanding of disability must encompass chronic illnesses. I argue that there are important differences between healthy disabled and unhealthy disabled people that are likely to affect such issues as treatment of impairment in disability and feminist politics, accommodation of disability in activism and employment, identification of persons as disabled, disability pride, and prevention and "cure" of disabilities.

Inferences from the absence of evidence to something are common in ordinary speech, but when used in scientific argumentations are usually considered deficient or outright false. Yet, as demonstrated here with the help of various examples, archaeologists frequently use inferences and reasoning from absence, often allowing it a status on par with inferences from tangible evidence. This discrepancy has not been examined so far. The article analyses it drawing on philosophical discussions concerning the validity of inference from absence, using probabilistic (...) models that were originally developed to show that such inferences are weak and inconclusive. The analysis reveals that inference from absence can indeed be justified in many important situations of archaeological research, such as excavations carried out to explore the past existence and time-span of sedentary human habitation. The justification is closely related to the fact that archaeology explores the human past via its material remains. The same analysis points to instances where inference from absence can have comparable validity in other historical sciences, and to research questions in which archaeological inference from absence will be problematic or totally unwarranted. (shrink)

The use of "theory" in feminist analysis has been said to threaten feminism as a political force. This collection of work by leading feminist scholars engages with the question of the political status of poststructuralism theory within feminism. Against the view that the use of post-structuralism necessarily weakens feminism, 'Feminists Theorize the Political' affirms the contemporary debate over theory as politically rich and consequential. In laying the theoretical groundwork for the volume, Butler and Scott posed a number of questions to (...) prominent legal scholars, literary critics, philosophers, political theorists, historians, and cultural theorists. The essays do not settle the questions but generate new and productive directions for them. The volume as a whole valorizes the unsettling power and politics of theory. The essays in 'Feminists Theorize the Political' speak to the questions that emerge from the convergence of feminism and poststructuralism: What happens to feminist critique when traditional foundations--experience, history, universal norms--are called into question? Can feminist theory problematize the notion of the subject without losing its political effectivity? Which version of the subject is to questioned, and how does that questioning open up possibilities for reformulating agency, power, and sites of political resistance? What are the consequences of a specifically feminist reformulation of difference? What are the uses and limits of a poststructuralist critique of binary logic for the theorization of racial and class differences, the position of the subaltern? This anthology represents a diverse array of theoretical work within feminist theory with strong political stakes. Although not all of the authors subscribe to poststructuralism, (and few would concede post-structuralism is a monolithic enterprise), each offers an innovative feminist analysis that is in some way motivated in and by the poststructuralist challenge. 'Feminists Theorize The Political' addresses a range of feminist concerns, including productive freedom, anti-discrimination law, rape, and formulating power in terms of exclusion, difference and hierarchy. (shrink)

This treatise covers the history, now more than 170 years long, of researches and debates concerning the biblical city of Ai. This archetypical chapter in the evolution of biblical archaeology and historiography was never presented in full. I use the historical data as a case study to explore a number of epistemological issues, such as the creation and revision of scientific knowledge, the formation and change of consensus, the Kuhnian model of paradigm shift, several models of discrimination between hypotheses about (...) the past, the interplay between scientists' values and their epistemic beliefs, and the truth-bearing of historiographic reconstruction. I show, in particular, that when scientists share common epistemic values they can modify their beliefs even when such changes go against deeply entrenched biases and preconceptions. Considerations of coherence usually constrain such modifications, and when sufficient data is available the result can be a profound change of beliefs. Several episodes of the "Ai debates" demonstrate, however, that similar change of beliefs will not occur when non-epistemic values take precedence. (shrink)

The intent of the exploration is not an attempt to uncover Oakeshott's intellectual influences, but rather to show the importance and coherence of Oakeshott's various themes by showing how they modify, amplify, and contrast with similar and related themes in the thought of seven better known thinkers - Montaigne, St. Augustine, Hegel, Hobbes, Benjamin Constant, Rousseau, and Hume."--BOOK JACKET.