The prospective robots in healthcare intended to be included within the conclave of the nurse-patient relationship—what I refer to as care robots—require rigorous ethical reflection to ensure their design and introduction do not impede the promotion of values and the dignity of patients at such a vulnerable and sensitive time in their lives. The ethical evaluation of care robots requires insight into the values at stake in the healthcare tradition. What’s more, given the stage of their development and lack of (...) standards provided by the International Organization for Standardization to guide their development, ethics ought to be included into the design process of such robots. The manner in which this may be accomplished, as presented here, uses the blueprint of the Value-sensitive design approach as a means for creating a framework tailored to care contexts. Using care values as the foundational values to be integrated into a technology and using the elements in care, from the care ethics perspective, as the normative criteria, the resulting approach may be referred to as care centered value-sensitive design. The framework proposed here allows for the ethical evaluation of care robots both retrospectively and prospectively. By evaluating care robots in this way, we may ultimately ask what kind of care we, as a society, want to provide in the future. (shrink)

Building artificial moral agents (AMAs) underscores the fragmentary character of presently available models of human ethical behavior. It is a distinctly different enterprise from either the attempt by moral philosophers to illuminate the “ought” of ethics or the research by cognitive scientists directed at revealing the mechanisms that influence moral psychology, and yet it draws on both. Philosophers and cognitive scientists have tended to stress the importance of particular cognitive mechanisms, e.g., reasoning, moral sentiments, heuristics, intuitions, or a moral grammar, (...) in the making of moral decisions. However, assembling a system from the bottom-up which is capable of accommodating moral considerations draws attention to the importance of a much wider array of mechanisms in honing moral intelligence. Moral machines need not emulate human cognitive faculties in order to function satisfactorily in responding to morally significant situations. But working through methods for building AMAs will have a profound effect in deepening an appreciation for the many mechanisms that contribute to a moral acumen, and the manner in which these mechanisms work together. Building AMAs highlights the need for a comprehensive model of how humans arrive at satisfactory moral judgments. (shrink)

Building artificial moral agents (AMAs) underscores the fragmentary character of presently available models of human ethical behavior. It is a distinctly different enterprise from either the attempt by moral philosophers to illuminate the “ought” of ethics or the research by cognitive scientists directed at revealing the mechanisms that influence moral psychology, and yet it draws on both. Philosophers and cognitive scientists have tended to stress the importance of particular cognitive mechanisms, e.g., reasoning, moral sentiments, heuristics, intuitions, or a moral grammar, (...) in the making of moral decisions. However, assembling a system from the bottom-up which is capable of accommodating moral considerations draws attention to the importance of a much wider array of mechanisms in honing moral intelligence. Moral machines need not emulate human cognitive faculties in order to function satisfactorily in responding to morally significant situations. But working through methods for building AMAs will have a profound effect in deepening an appreciation for the many mechanisms that contribute to a moral acumen, and the manner in which these mechanisms work together. Building AMAs highlights the need for a comprehensive model of how humans arrive at satisfactory moral judgments. (shrink)

The prospective robots in healthcare intended to be included within the conclave of the nurse-patient relationship—what I refer to as care robots—require rigorous ethical reflection to ensure their design and introduction do not impede the promotion of values and the dignity of patients at such a vulnerable and sensitive time in their lives. The ethical evaluation of care robots requires insight into the values at stake in the healthcare tradition. What’s more, given the stage of their development and lack of (...) standards provided by the International Organization for Standardization to guide their development, ethics ought to be included into the design process of such robots. The manner in which this may be accomplished, as presented here, uses the blueprint of the Value-sensitive design approach as a means for creating a framework tailored to care contexts. Using care values as the foundational values to be integrated into a technology and using the elements in care, from the care ethics perspective, as the normative criteria, the resulting approach may be referred to as care centered value-sensitive design. The framework proposed here allows for the ethical evaluation of care robots both retrospectively and prospectively. By evaluating care robots in this way, we may ultimately ask what kind of care we, as a society, want to provide in the future. (shrink)

Notwithstanding the fact that care ethics has received increased attention, it has also faced much criticism. One of the focal points of critics is the normativity of care. Only when the objective normative basis of care is sufficiently clarified can care practices be evaluated and optimized from an ethical point of view. We emphasize that two levels of normativity can be identified: the context level and the foundational anthropology level. The personalist approach to care ethics is normatively stronger, at least (...) on one level, namely the foundational anthropology level. This personalist approach to care ethics indicates in which direction action must be taken so that human action may be considered ethically sound. (shrink)

In the early twenty-first century, we stand on the threshold of welcoming robots into domains of human activity that will expand their presence in our lives dramatically. One provocative new frontier in robotics, motivated by a convergence of demographic, economic, cultural, and institutional pressures, is the development of “carebots”—robots intended to assist or replace human caregivers in the practice of caring for vulnerable persons such as the elderly, young, sick, or disabled. I argue here that existing philosophical reflections on the (...) ethical implications of carebots neglect a critical dimension of the issue: namely, the potential moral value of caregiving practices for caregivers. This value, I argue, gives rise to considerations that must be weighed alongside consideration of the likely impact of carebots on care recipients. Focusing on the goods internal to caring practices, I then examine the potential impact of carebots on caregivers by means of three complementary ethical approaches: virtue ethics, care ethics, and the capabilities approach. Each of these, I argue, sheds new light on the contexts in which carebots might deprive potential caregivers of important moral goods central to caring practices, as well as those contexts in which carebots might help caregivers sustain or even enrich those practices, and their attendant goods. (shrink)

How do we know which institutions provide good care? Some scholars argue that the best way to think about care institutions is to model them upon the family or the market. This paper argues, on the contrary, that when we make explicit some background conditions of good family care, we can apply what we know to better institutionalized caring. After considering elements of bad and good care, from an institutional perspective, the paper argues that good care in an institutional context (...) has three central foci: the purpose of care, a recognition of power relations, and the need for pluralistic, particular tailoring of care to meet individuals? needs. These elements further require political space within institutions to address such concerns. (shrink)

It is remarkable how much robotics research is promoted by appealing to the idea that the only way to deal with a looming demographic crisis is to develop robots to look after older persons. This paper surveys and assesses the claims made on behalf of robots in relation to their capacity to meet the needs of older persons. We consider each of the roles that has been suggested for robots in aged care and attempt to evaluate how successful robots might (...) be in these roles. We do so from the perspective of writers concerned primarily with the quality of aged care, paying particular attention to the social and ethical implications of the introduction of robots, rather than from the perspective of robotics, engineering, or computer science. We emphasis the importance of the social and emotional needs of older persons—which, we argue, robots are incapable of meeting—in almost any task involved in their care. Even if robots were to become capable of filling some service roles in the aged-care sector, economic pressures on the sector would most likely ensure that the result was a decrease in the amount of human contact experienced by older persons being cared for, which itself would be detrimental to their well-being. This means that the prospects for the ethical use of robots in the aged-care sector are far fewer than first appears. More controversially, we believe that it is not only misguided, but actually unethical, to attempt to substitute robot simulacra for genuine social interaction. A subsidiary goal of this paper is to draw attention to the discourse about aged care and robotics and locate it in the context of broader social attitudes towards older persons. We conclude by proposing a deliberative process involving older persons as a test for the ethics of the use of robots in aged care. (shrink)

Current uses of robots in classrooms are reviewed and used to characterise four scenarios: Robot as Classroom Teacher; Robot as Companion and Peer; Robot as Care-eliciting Companion; and Telepresence Robot Teacher. The main ethical concerns associated with robot teachers are identified as: privacy; attachment, deception, and loss of human contact; and control and accountability. These are discussed in terms of the four identified scenarios. It is argued that classroom robots are likely to impact children’s’ privacy, especially when they masquerade as (...) their friends and companions, when sensors are used to measure children’s responses, and when records are kept. Social robots designed to appear as if they understand and care for humans necessarily involve some deception, and could increase the risk of reduced human contact. Children could form attachments to robot companions, or robot teachers and this could have a deleterious effect on their social development. There are also concerns about the ability, and use of robots to control or make decisions about children’s behaviour in the classroom. It is concluded that there are good reasons not to welcome fully fledged robot teachers, and that robot companions should be given a cautious welcome at best. The limited circumstances in which robots could be used in the classroom to improve the human condition by offering otherwise unavailable educational experiences are discussed. (shrink)

This paper explores the relationship between dignity and robot care for older people. It highlights the disquiet that is often expressed about failures to maintain the dignity of vulnerable older people, but points out some of the contradictory uses of the word ‘dignity’. Certain authors have resolved these contradictions by identifying different senses of dignity; contrasting the inviolable dignity inherent in human life to other forms of dignity which can be present to varying degrees. The Capability Approach (CA) is introduced (...) as a different but tangible account of what it means to live a life worthy of human dignity. It is used here as a framework for the assessment of the possible effects of eldercare robots on human dignity. The CA enables the identification of circumstances in which robots could enhance dignity by expanding the set of capabilities that are accessible to frail older people. At the same time, it is also possible within its framework to identify ways in which robots could have a negative impact, by impeding the access of older people to essential capabilities. It is concluded that the CA has some advantages over other accounts of dignity, but that further work and empirical study is needed in order to adapt it to the particular circumstances and concerns of those in the latter part of their lives. (shrink)

The growing proportion of elderly people in society, together with recent advances in robotics, makes the use of robots in elder care increasingly likely. We outline developments in the areas of robot applications for assisting the elderly and their carers, for monitoring their health and safety, and for providing them with companionship. Despite the possible benefits, we raise and discuss six main ethical concerns associated with: (1) the potential reduction in the amount of human contact; (2) an increase in the (...) feelings of objectification and loss of control; (3) a loss of privacy; (4) a loss of personal liberty; (5) deception and infantilisation; (6) the circumstances in which elderly people should be allowed to control robots. We conclude by balancing the care benefits against the ethical costs. If introduced with foresight and careful guidelines, robots and robotic technology could improve the lives of the elderly, reducing their dependence, and creating more opportunities for social interaction. (shrink)

P. M. Asaro: What should We Want from a Robot Ethic? G. Tamburrini: Robot Ethics: A View from the Philosophy of Science B. Becker: Social Robots - Emotional Agents: Some Remarks on Naturalizing Man-machine Interaction E. Datteri, G. Tamburrini: Ethical Reflections on Health Care Robotics P. Lin, G. Bekey, K. Abney: Robots in War: Issues of Risk and Ethics J. Altmann: Preventive Arms Control for Uninhabited Military Vehicles J. Weber: Robotic warfare, Human Rights & The Rhetorics of Ethical Machines T. (...) Nishida: Towards Robots with Good Will R. Capurro: Ethics and Robotics. (shrink)

In this article I wish to show how care ethics puts forward a fundamental critique on the ideal of independency in human life without thereby discounting autonomy as a moral value altogether. In care ethics, a relational account of autonomy is developed instead. Because care ethics is sometimes criticized in the literature as hopelessly vague and ambiguous, I shall begin by elaborating on how care ethics and its place in ethical theory can be understood. I shall stipulate a definition of (...) care ethics as a moral perspective or orientation from which ethical theorizing can take place. This will mean that care ethics is more a stance from which we can theorize ethically, than ready-made theory in itself. In conceiving care ethics in this way, it becomes possible to make clear that, for instance, a moral concept of autonomy is not abandoned, but instead is given a particular place and interpretation. In the final part of this article I will show how ‘relational autonomy’ can be applied fruitfully in the practice of psychiatric care. (shrink)

Recently, there is increased attention to the integration of moral values into the conception, design, and development of emerging IT. The most reviewed approach for this purpose in ethics and technology so far is Value-Sensitive Design (VSD). This article considers VSD as the prime candidate for implementing normative considerations into design. Its methodology is considered from a conceptual, analytical, normative perspective. The focus here is on the suitability of VSD for integrating moral values into the design of technologies in a (...) way that joins in with an analytical perspective on ethics of technology. Despite its promising character, it turns out that VSD falls short in several respects: (1) VSD does not have a clear methodology for identifying stakeholders, (2) the integration of empirical methods with conceptual research within the methodology of VSD is obscure, (3) VSD runs the risk of committing the naturalistic fallacy when using empirical knowledge for implementing values in design, (4) the concept of values, as well as their realization, is left undetermined and (5) VSD lacks a complimentary or explicit ethical theory for dealing with value trade-offs. For the normative evaluation of a technology, I claim that an explicit and justified ethical starting point or principle is required. Moreover, explicit attention should be given to the value aims and assumptions of a particular design. The criteria of adequacy for such an approach or methodology follow from the evaluation of VSD as the prime candidate for implementing moral values in design. (shrink)

In this paper, I urge that the very real lessons Carol Gilligan's work in moral psychology offer to moral philosophy can best be appreciated if we take seriously the gap between the two disciplines. The care and justice perspectives Gilligan explores are psychological orientations, and orientations are defined as much by matters of emphasis, selectivity of interpretation, and gestalt as they are by propositional commitment. As such, I argue, their contribution to moral theory is best seen as stances from which (...) to do theory, rather than as constituting ready-made theories themselves. In pursuing this train of thought, I examine how Gilligan's work has developed over time and how, in the end, we should understand the juxtaposition between the two orientations. (shrink)

Ethical concerns regarding agricultural practices can be found to co-evolve with technological developments. This paper aims to create an understanding of ethics that is helpful in debating technological innovation by studying such a co-evolution process in detail: the development and adoption of the milking robot. Over the last decade an increasing number of milking robots, or automatic milking systems (AMS), has been adopted, especially in the Netherlands and a few other Western European countries. The appraisal of this new technology in (...) ethical terms has appeared to be a complicated matter. Compared to using a conventional milking parlor, the use of an AMS entails in several respects a different practice of dairy farming, the ethical implications and evaluation of which are not self-evident but are themselves part of a dynamic process. It has become clear that with its use, the entire practice of dairy farming has been reorganized around this new device. With a robot, cows must voluntarily present themselves to be milked, whereby an ethical norm of (individual) freedom for cows can be seen to emerge together with this new technology. But adopting a robot also implies changes in what is considered to be a good farmer and an appropriate relation between farmer and cow. Through interviews, attending “farmers’ network” meetings in the Netherlands, and studying professional literature and dedicated dairy farming web forums, this paper traces the way that ethical concerns are a dynamic part of this process of rearranging a variety of elements of the practice of dairy farming. (shrink)

First Published in 1993. Routledge is an imprint of Taylor & Francis, an informa company.

Computers are already approving financial transactions, controlling electrical supplies, and driving trains. Soon, service robots will be taking care of the elderly in their homes, and military robots will have their own targeting and firing protocols. Colin Allen and Wendell Wallach argue that as robots take on more and more responsibility, they must be programmed with moral decision-making abilities, for our own safety. Taking a fast paced tour through the latest thinking about philosophical ethics and artificial intelligence, the authors argue (...) that even if full moral agency for machines is a long way off, it is already necessary to start building a kind of functional morality, in which artificial moral agents have some basic ethical sensitivity. But the standard ethical theories don't seem adequate, and more socially engaged and engaging robots will be needed. As the authors show, the quest to build machines that are capable of telling right from wrong has begun. -/- Moral Machines is the first book to examine the challenge of building artificial moral agents, probing deeply into the nature of human decision making and ethics. (shrink)

Robots today serve in many roles, from entertainer to educator to executioner. As robotics technology advances, ethical concerns become more pressing: Should robots be programmed to follow a code of ethics, if this is even possible? Are there risks in forming emotional bonds with robots? How might society--and ethics--change with robotics? This volume is the first book to bring together prominent scholars and experts from both science and the humanities to explore these and other questions in this emerging field. Starting (...) with an overview of the issues and relevant ethical theories, the topics flow naturally from the possibility of programming robot ethics to the ethical use of military robots in war to legal and policy questions, including liability and privacy concerns. The contributors then turn to human-robot emotional relationships, examining the ethical implications of robots as sexual partners, caregivers, and servants. Finally, they explore the possibility that robots, whether biological-computational hybrids or pure machines, should be given rights or moral consideration. Ethics is often slow to catch up with technological developments. This authoritative and accessible volume fills a gap in both scholarly literature and policy discussion, offering an impressive collection of expert analyses of the most crucial topics in this increasingly important field. (shrink)

The essays in this volume represent the first steps by philosophers and artificial intelligence researchers toward explaining why it is necessary to add an ...

There are at least three things we might mean by "ethics in robotics": the ethical systems built into robots, the ethics of people who design and use robots, and the ethics of how people treat robots. This paper argues that the best approach to robot ethics is one which addresses all three of these, and to do this it ought to consider robots as socio-technical systems. By so doing, it is possible to think of a continuum of agency that lies (...) between amoral and fully autonomous moral agents. Thus, robots might move gradually along this continuum as they acquire greater capabilities and ethical sophistication. It also argues that many of the issues regarding the distribution of responsibility in complex socio-technical systems might best be addressed by looking to legal theory, rather than moral theory. This is because our overarching interest in robot ethics ought to be the practical one of preventing robots from doing harm, as well as preventing humans from unjustly avoiding responsibility for their actions. (shrink)

This paper deals with the birth of Roboethics. Roboethics is the ethics inspiring the design, development and employment of Intelligent Machines. Roboethics shares many 'sensitive areas' with Computer Ethics, Information Ethics and Bioethics. It investigates the social and ethical problems due to the effects of the Second and Third Industrial Revolutions in the Humans/Machines interaction's domain. Urged by the responsibilities involved in their professions, an increasing number of roboticists from all over the world have started - in cross-cultural collaboration with (...) scholars of Humanities - to thoroughly develop the Roboethics, the applied ethics that should inspire the design, manufacturing and use of robots. The result is the Roboethics Roadmap. (shrink)