Artificial intelligence and robotics is pervasive in daily life and set to expand to new levels potentially replacing human decision-making and action. Self-driving cars, home and healthcare robots, and autonomous weapons are some examples. A distinction appears to be emerging between potentially benevolent civilian uses of the technology (eg unmanned aerial vehicles delivering medicines), and potentially malevolent military uses (eg lethal autonomous weapons killing human com- batants). Machine-mediated human interaction challenges the philosophical basis of human existence and ethical conduct. (...) Aside from technical challenges of ensuring ethical conduct in artificial intelligence and robotics, there are moral questions about the desirability of replacing human functions and the human mind with such technology. How will artificial intelligence and robotics engage in moral reasoning in order to act ethically? Is there a need for a new set of moral rules? What happens to human interaction when it is mediated by technology? Should such technology be used to end human life? Who bears responsibility for wrongdoing or harmful conduct by artificial intelligence and robotics? -/- Whilst Kant may be familiar to international lawyers for setting restraints on the use of force and rules for perpetual peace, his foundational work on ethics provides an inclusive moral philosophy for assessing ethical conduct of individuals and states and, thus, is relevant to discussions on the use and development of artificial intelligence and robotics. His philosophy is inclusive because it incorporates justifications for morals and legitimate responses to immoral conduct, and applies to all human agents irrespective of whether they are wrongdoers, unlawful combatants, or unjust enemies. Humans are at the centre of rational thinking, action, and norm-creation so that the rationale for restraints on methods and means of warfare, for example, is based on preserving human dignity as well as ensuring conditions for perpetual peace among states. Unlike utilitarian arguments which favour use of autonomous weapons on the basis of cost-benefit reasoning or the potential to save lives, Kantian ethics establish non-consequentialist and deontological rules which are good in themselves to follow and not dependent on expediency or achieving a greater public good. -/- Kantian ethics make two distinct contributions to the debate. First, they provide a human-centric ethical framework whereby human exist- ence and capacity are at the centre of a norm-creating moral philosophy guiding our understanding of moral conduct. Second, the ultimate aim of Kantian ethics is practical philosophy that is relevant and applicable to achieving moral conduct. -/- I will seek to address the moral questions outlined above by exploring how core elements of Kantian ethics relate to use of artificial intelli- gence and robotics in the civilian and military spheres. Section 2 sets out and examines core elements of Kantian ethics: the categorical imperative; autonomy of the will; rational beings and rational thinking capacity; and human dignity and humanity as an end in itself. Sections 3-7 consider how these core elements apply to artificial intelligence and robotics with discussion of fully autonomous and human-machine rule-generating approaches; types of moral reasoning; the difference be- tween ‘human will’ and ‘machine will’; and respecting human dignity. (shrink)

In this paper, I examine a variety of agents that appear in Kantian ethics in order to determine which would be necessary to make a robot a genuine moral agent. However, building such an agent would require that we structure into a robot’s behavioral repertoire the possibility for immoral behavior, for only then can the moral law, according to Kant, manifest itself as an ought, a prerequisite for being able to hold an agent morally accountable for its actions. Since (...) building a moral robot requires the possibility of immoral behavior, I go on to argue that we cannot morally want robots to be genuine moral agents, but only beings that simulate moral behavior. Finally, I raise but do not answer the question that if morality requires us to want robots that are not genuine moral agents, why should we want something different in the case of human beings. (shrink)

In this paper, I examine a variety of agents that appear in Kantian ethics in order to determine which would be necessary to make a robot a genuine moral agent. However, building such an agent would require that we structure into a robot’s behavioral repertoire the possibility for immoral behavior, for only then can the moral law, according to Kant, manifest itself as an ought, a prerequisite for being able to hold an agent morally accountable for its actions. Since (...) building a moral robot requires the possibility of immoral behavior, I go on to argue that we cannot morally want robots to be genuine moral agents, but only beings that simulate moral behavior. But then, if that is what we want for robots, why should we want something different for human beings? Robot ethics, it seems, presents something of a reductio of Kant’s ethics that points to hidden assumptions that hide in the very fabric of the Kantian moral enterprise, not the least of which is that Kant presumes humans to be fallen creatures. Religious doctrine, in other words, infects Kant’s attempt to derive morality from reason. This paper will demonstrate that this is so. (shrink)

The use of autonomous and intelligent personal social robots raises questions concerning their moral standing. Moving away from the discussion about direct moral standing and exploring the normative implications of a relational approach to moral standing, this paper offers four arguments that justify giving indirect moral standing to robots under specific conditions based on some of the ways humans—as social, feeling, playing, and doubting beings—relate to them. The analogy of “the Kantian dog” is used to assist reasoning about this. (...) The paper also discusses the implications of this approach for thinking about the moral standing of animals and humans, showing why, when, and how an indirect approach can also be helpful in these fields, and using Levinas and Dewey as sources of inspiration to discuss some challenges raised by this approach. (shrink)

In this article, I review textual evidence demonstrating that James and Dewey incorporated Kant’s ideas, even while criticizing him. I specifically argue that the pragmatic evolution of the Kantian a priori carried out by James and Dewey is a transition from the mental to the bodily. I further argue that the parallels between pragmatists and Kant, along with the transition from the mental to bodily, relate to scientific contexts in which all developed their outlooks. Though historically grounded, my ultimate (...) goal is to show that pragmatism and by extension Kantianism mesh with and indeed contribute to cutting edge ideas in fields ranging from neuropathology to robotics and AI to cognitive science, whether in the form of Gibsonian theory or enactivism. (shrink)

This paper presents an African relational view of social robots’ moral standing which draws on the philosophy of ubuntu. The introduction places the question of moral standing in historical and cultural contexts. Section 2 demonstrates an ubuntu framework by applying it to the fictional case of a social robot named Klara, taken from Ishiguro’s novel, Klara and the Sun. We argue that an ubuntu ethic assigns moral standing to Klara, based on her relational qualities and pro-social virtues. Section 3 introduces (...) a second fictional case, taken from McKeown’s novel, Machines Like Me, in which a social robot named Adam displays intrinsic qualities, such as sentience, rationality, and deductive moral reasoning, yet lacks close social ties to particular people. We argue that Adam is not a person in the African sense; however, he qualifies as a person according to many standard Western views, such as Kantian and utilitarian ethics. Section 4 further elaborates the African relational view by comparing the moral standing of social robots and humans in a forced choice scenario. Section 5 replies to objections. We conclude that an African relational approach captures important insights about the moral standing of social robots that many Western accounts miss and should be better incorporated into global frameworks for designing and deploying social robots. (shrink)

Some argue that robots could never be sentient, and thus could never have intrinsic moral status. Others disagree, believing that robots indeed will be sentient and thus will have moral status. But a third group thinks that, even if robots could never have moral status, we still have a strong moral reason to treat some robots as if they do. Drawing on a Kantian argument for indirect animal rights, a number of technology ethicists contend that our treatment of anthropomorphic (...) or even animal-like robots could condition our treatment of humans: treat these robots well, as we would treat humans, or else risk eroding good moral behavior toward humans. But then, this argument also seems to justify giving rights to robots, even if robots lack intrinsic moral status. In recent years, however, this indirect argument in support of robot rights has drawn a number of objections. In this paper I have three goals. First, I will formulate and explicate the Kant-inspired indirect argument meant to support robot rights, making clearer than before its empirical commitments and philosophical presuppositions. Second, I will defend the argument against a number of objections. The result is the fullest explication and defense to date of this well-known and influential but often criticized argument. Third, however, I myself will raise a new concern about the argument’s use as a justification for robot rights. This concern is answerable to some extent, but it cannot be dismissed fully. It shows that, surprisingly, the argument’s advocates have reason to resist, at least somewhat, producing the sorts of robots that, on their view, ought to receive rights. (shrink)

That the successful development of fully autonomous artificial moral agents (AMAs) is imminent is becoming the received view within artificial intelligence research and robotics. The discipline of Machines Ethics, whose mandate is to create such ethical robots, is consequently gaining momentum. Although it is often asked whether a given moral framework can be implemented into machines, it is never asked whether it should be. This paper articulates a pressing challenge for Machine Ethics: To identify an ethical framework that is (...) both implementable into machines and whose tenets permit the creation of such AMAs in the first place. Without consistency between ethics and engineering, the resulting AMAs would not be genuine ethical robots, and hence the discipline of Machine Ethics would be a failure in this regard. Here this challenge is articulated through a critical analysis of the development of Kantian AMAs, as one of the leading contenders for being the ethic that can be implemented into machines. In the end, however, the development of Kantian artificial moral machines is found to be anti-Kantian. The upshot of all this is that machine ethicists need to look elsewhere for an ethic to implement into their machines. (shrink)

Wendell Wallach and Colin Allen’s Moral Machines: Teaching Robots Right From Wrong (Oxford University Press, 2009) explores efforts to develop machines that, not only can be employed for good or bad ends, but which themselves can be held morally accountable for what they do— artificial moral agents (AMAs). This essay is a critical response to Wallach and Allen’s conjectures. Although Wallach and Allen do not suggest that we are close to being able to create full-fledged AMAs, they do talk seriously (...) about making incremental progress in the direction of creating them (even if we never fully succeed). However, there are important questions about the moral development of AMAs that Moral Machines does not address. Given the responsibilities entrusted to human moral agents, we take questions about their moral development very seriously. In the case of children, the hope is that eventually they will develop into full-fledged moral agents. How might we expect this to go with less than fully formed AMAs? Will there be a comparable story of moral development and moral education that we can tell? (shrink)

In this brief reply to Anne Margaret Baxley’s comments on my paper, “Exiting the State and Debunking the State of Nature,” I respond to her two critical worries about my thesis that there is an unbridgeable gap between Kant’s political theory, which is classically liberal, and his ethics/theory of enlightenment/moral theology, which is anarchist: that Kant’s strong moral epistemic skepticism in the Groundwork about knowing the true motives of our choices and actions, requires coercive State intervention in order to ensure (...) that we heed mutual relations of external freedom and do our juridical duties, and that the overall crookedness of the human timber, i.e., our almost inevitable empirical tendency to fall short of autocracy, requires the very same State interventions for the very same moral-political straightening purposes. I argue that Kant isn’t the moral epistemic skeptic he’s standardly taken to be—on the contrary, we have veridical, direct, occurrent, essentially non-conceptual, non-empirical awareness of autonomous choices and actions, via The Fact of Reason, and that coercing people to be morally good necessarily undermines the moral worth of their choices and actions and turns them into nothing but well-oiled, law-abiding robots of the State—so we must exit the State in order to belong to an ethical community instead, i.e., Kantian anarchism; hence my unbridgeable-gap thesis still stands. I end by self-advertising for existential Kantian cosmopolitan anarchism. (shrink)

We are living through an era of increased robotisation. Some authors have already begun to explore the impact of this robotisation on legal rules and practice. In doing so, many highlight potential liability gaps that might arise through robot misbehaviour. Although these gaps are interesting and socially significant, they do not exhaust the possible gaps that might be created by increased robotisation. In this article, I make the case for one of those alternative gaps: the retribution gap. This gap arises (...) from a mismatch between the human desire for retribution and the absence of appropriate subjects of retributive blame. I argue for the potential existence of this gap in an era of increased robotisation; suggest that it is much harder to plug this gap than it is to plug those thus far explored in the literature; and then highlight three important social implications of this gap. (shrink)

Can robots have significant moral status? This is an emerging topic of debate among roboticists and ethicists. This paper makes three contributions to this debate. First, it presents a theory – ‘ethical behaviourism’ – which holds that robots can have significant moral status if they are roughly performatively equivalent to other entities that have significant moral status. This theory is then defended from seven objections. Second, taking this theoretical position onboard, it is argued that the performative threshold that robots need (...) to cross in order to be afforded significant moral status may not be that high and that they may soon cross it (if they haven’t done so already). Finally, the implications of this for our procreative duties to robots are considered, and it is argued that we may need to take seriously a duty of ‘procreative beneficence’ towards robots. (shrink)

The United States Army’s Future Combat Systems Project, which aims to manufacture a “robot army” to be ready for deployment by 2012, is only the latest and most dramatic example of military interest in the use of artificially intelligent systems in modern warfare. This paper considers the ethics of a decision to send artificially intelligent robots into war, by asking who we should hold responsible when an autonomous weapon system is involved in an atrocity of the sort that would normally (...) be described as a war crime. A number of possible loci of responsibility for robot war crimes are canvassed; the persons who designed or programmed the system, the commanding officer who ordered its use, the machine itself. I argue that in fact none of these are ultimately satisfactory. Yet it is a necessary condition for fighting a just war, under the principle of jus in bellum, that someone can be justly held responsible for deaths that occur in the course of the war. As this condition cannot be met in relation to deaths caused by an autonomous weapon system it would therefore be unethical to deploy such systems in warfare. (shrink)

If a robot sends a deceptive signal to a human user, is this always and everywhere an unethical act, or might it sometimes be ethically desirable? Building upon previous work in robot ethics, this article tries to clarify and refine our understanding of the ethics of robotic deception. It does so by making three arguments. First, it argues that we need to distinguish between three main forms of robotic deception (external state deception; superficial state deception; and hidden state deception) in (...) order to think clearly about its ethics. Second, it argues that the second type of deception – superficial state deception – is not best thought of as a form of deception, even though it is frequently criticised as such. And third, it argues that the third type of deception is best understood as a form of betrayal because doing so captures the unique ethical harm to which it gives rise, and justifies special ethical protections against its use. (shrink)

Robots are increasingly envisaged as our future cohabitants. However, while considerable progress has been made in recent years in terms of their technological realization, the ability of robots to inter-act with humans in an intuitive and social way is still quite limited. An important challenge for social robotics is to determine how to design robots that can perceive the user’s needs, feelings, and intentions, and adapt to users over a broad range of cognitive abilities. It is conceivable that if (...) robots were able to adequately demonstrate this, humans would eventually accept them as social companions. We argue that the best way to achieve this is using a systematic experimental approach based on behavioral and physiological neuroscience methods such as motion/eye tracking, electroencephalography (EEG), or functional near-infrared spectroscopy (fNIRS) embedded in interactive human-robot paradigms. This approach requires understanding how humans interact with each other, how they perform tasks together and how they develop feelings of social connection over time, and using these insights to formulate design principles that make social robots attuned to the workings of the human brain. In this review, we put forward the argument that the likelihood of artificial agents being perceived as social companions can be increased by designing them in a way that they are perceived as intentional agents that activate areas in the human brain involved in social-cognitive processing. We first review literature related to social-cognitive mechanisms involved in human-human interactions, and high-light the importance of perceiving others as intentional agents to activate these brain areas. We then discuss how attribution of intentionality can positively affect human-robot interaction by (a) fostering feelings of social connection, empathy and prosociality, and by (b) enhancing performance on joint human-robot tasks. Lastly, we describe circumstances under which attribution of intentionality to robot agents might be disadvantageous, and discuss challenges associated with designing social robots that are inspired by neuroscientific principles. (shrink)

Sex robots are likely to play an important role in shaping public understandings of sex and of relations between the sexes in the future. This paper contributes to the larger project of understanding how they will do so by examining the ethics of the “rape” of robots. I argue that the design of realistic female robots that could explicitly refuse consent to sex in order to facilitate rape fantasy would be unethical because sex with robots in these circumstances is a (...) representation of the rape of a woman, which may increase the rate of rape, expresses disrespect for women, and demonstrates a significant character defect. Even when the intention is not to facilitate rape, the design of robots that can explicitly refuse consent is problematic due to the likelihood that some users will experiment with raping them. Designing robots that lack the capacity to explicitly refuse consent may be morally problematic depending on which of two accounts of the representational content of sex with realistic humanoid robots is correct. (shrink)

The prospective robots in healthcare intended to be included within the conclave of the nurse-patient relationship—what I refer to as care robots—require rigorous ethical reflection to ensure their design and introduction do not impede the promotion of values and the dignity of patients at such a vulnerable and sensitive time in their lives. The ethical evaluation of care robots requires insight into the values at stake in the healthcare tradition. What’s more, given the stage of their development and lack of (...) standards provided by the International Organization for Standardization to guide their development, ethics ought to be included into the design process of such robots. The manner in which this may be accomplished, as presented here, uses the blueprint of the Value-sensitive design approach as a means for creating a framework tailored to care contexts. Using care values as the foundational values to be integrated into a technology and using the elements in care, from the care ethics perspective, as the normative criteria, the resulting approach may be referred to as care centered value-sensitive design. The framework proposed here allows for the ethical evaluation of care robots both retrospectively and prospectively. By evaluating care robots in this way, we may ultimately ask what kind of care we, as a society, want to provide in the future. (shrink)

The development of autonomous, robotic weaponry is progressing rapidly. Many observers agree that banning the initiation of lethal activity by autonomous weapons is a worthy goal. Some disagree with this goal, on the grounds that robots may equal and exceed the ethical conduct of human soldiers on the battlefield. Those who seek arms-control agreements limiting the use of military robots face practical difficulties. One such difficulty concerns defining the notion of an autonomous action by a robot. Another challenge concerns how (...) to verify and monitor the capabilities of rapidly changing technologies. In this article we describe concepts from our previous work about autonomy and ethics for robots and apply them to military robots and robot arms control. We conclude with a proposal for a first step toward limiting the deployment of autonomous weapons capable of initiating lethal force. (shrink)

Sex robots are already a reality: in this provocative text, Maurizio Balistreri explores the fascinating world of future sex, exploring the ethical questions raised by the existence of a sex robot industry.

This paper explores the relationship between dignity and robot care for older people. It highlights the disquiet that is often expressed about failures to maintain the dignity of vulnerable older people, but points out some of the contradictory uses of the word ‘dignity’. Certain authors have resolved these contradictions by identifying different senses of dignity; contrasting the inviolable dignity inherent in human life to other forms of dignity which can be present to varying degrees. The Capability Approach (CA) is introduced (...) as a different but tangible account of what it means to live a life worthy of human dignity. It is used here as a framework for the assessment of the possible effects of eldercare robots on human dignity. The CA enables the identification of circumstances in which robots could enhance dignity by expanding the set of capabilities that are accessible to frail older people. At the same time, it is also possible within its framework to identify ways in which robots could have a negative impact, by impeding the access of older people to essential capabilities. It is concluded that the CA has some advantages over other accounts of dignity, but that further work and empirical study is needed in order to adapt it to the particular circumstances and concerns of those in the latter part of their lives. (shrink)

Social robots are robots that can interact socially with humans. As social robots and the artificial intelligence that powers them becomes more advanced, they will likely take on more social and work roles. This has many important ethical implications. In this paper, we focus on one of the most central of these, the impacts that social robots can have on human autonomy. We argue that, due to their physical presence and social capacities, there is a strong potential for social robots (...) to enhance human autonomy as well as several ways they can inhibit and disrespect it. We argue that social robots could improve human autonomy by helping us to achieve more valuable ends, make more authentic choices, and improve our autonomy competencies. We also argue that social robots have the potential to harm human autonomy by instead leading us to achieve fewer valuable ends ourselves, make less authentic choices, decrease our autonomy competencies, make our autonomy more vulnerable, and disrespect our autonomy. Whether the impacts of social robots on human autonomy are positive or negative overall will depend on the design, regulation, and use we make of social robots in the future. (shrink)

Soon there will be sex robots. The creation of such devices raises a host of social, legal and ethical questions. In this article, I focus in on one of them. What if these sex robots are deliberately designed and used to replicate acts of rape and child sexual abuse? Should the creation and use of such robots be criminalised, even if no person is harmed by the acts performed? I offer an argument for thinking that they should be. The argument (...) consists of two premises. The first claims that it can be a proper object of the criminal law to regulate wrongful conduct with no extrinsically harmful effects on others. The second claims that the use of robots that replicate acts of rape and child sexual abuse would be wrongful, even if such usage had no extrinsically harmful effects on others. I defend both premises of this argument and consider its implications for the criminal law. I do not offer a conclusive argument for criminalisation, nor would I wish to be interpreted as doing so; instead, I offer a tentative argument and a framework for future debate. This framework may also lead one to question the proposed rationales for criminalisation. (shrink)

I suggest that the Kantian categorical imperative can be a basis for an ethical duty to live sustainably. The universalizability formulation of the categorical imperative should be seen as a test of whether the principle underlying a way of life is self-destructive of the system of living and acting which makes the way of life possible. In exploring this interpretation the self should be conceptualized as a socially and system-constituted being, rather than an atomized will. In this sense, a (...) self which lives in a way that is destructive of the system of life, is also in principle willing its own self-destruction. (shrink)

This paper offers a theoretical framework that can be used to derive viable engineering strategies for the design and development of robots that can nudge people towards moral improvement. The framework relies on research in developmental psychology and insights from Stoic ethics. Stoicism recommends contemplative practices that over time help one develop dispositions to behave in ways that improve the functioning of mechanisms that are constitutive of moral cognition. Robots can nudge individuals towards these practices and can therefore help develop (...) the dispositions to, for example, extend concern to others, avoid parochialism, etc. (shrink)

The development of highly humanoid sex robots is on the technological horizon. If sex robots are integrated into the legal community as “electronic persons”, the issue of sexual consent arises, which is essential for legally and morally permissible sexual relations between human persons. This paper explores whether it is conceivable, possible, and desirable that humanoid robots should be designed such that they are capable of consenting to sex. We consider reasons for giving both “no” and “yes” answers to these three (...) questions by examining the concept of consent in general, as well as critiques of its adequacy in the domain of sexual ethics; the relationship between consent and free will; and the relationship between consent and consciousness. Additionally we canvass the most influential existing literature on the ethics of sex with robots. (shrink)

Robots are becoming an increasingly pervasive feature of our personal lives. As a result, there is growing importance placed on examining what constitutes appropriate behavior when they interact with human beings. In this paper, we discuss whether companion robots should be permitted to “nudge” their human users in the direction of being “more ethical”. More specifically, we use Rawlsian principles of justice to illustrate how robots might nurture “socially just” tendencies in their human counterparts. Designing technological artifacts in such a (...) way to influence human behavior is already well-established but merely because the practice is commonplace does not necessarily resolve the ethical issues associated with its implementation. (shrink)

The uncanny valley—the unnerving nature of humanlike robots—is an intriguing idea, but both its existence and its underlying cause are debated. We propose that humanlike robots are not only unnerving, but are so because their appearance prompts attributions of mind. In particular, we suggest that machines become unnerving when people ascribe to them experience, rather than agency. Experiment 1 examined whether a machine’s humanlike appearance prompts both ascriptions of experience and feelings of unease. Experiment 2 tested whether a machine capable (...) of experience remains unnerving, even without a humanlike appearance. Experiment 3 investigated whether the perceived lack of experience can also help explain the creepiness of unfeeling humans and philosophical zombies. These experiments demonstrate that feelings of uncanniness are tied to perceptions of experience, and also suggest that experience—but not agency—is seen as fundamental to humans, and fundamentally lacking in machines. (shrink)

A growing body of research can be found in which roboticists are designing for reciprocity as a key construct for successful human–robot interaction (HRI). Given the centrality of reciprocity as a component for our moral lives (for moral development and maintaining the just society), this paper confronts the possibility of what things would look like if the benchmark to achieve perceived reciprocity were accomplished. Through an analysis of the value of reciprocity from the care ethics tradition the richness of reciprocity (...) as an inherent value is revealed: on the micro-level, as mutual care for immediate care givers, and on the macro-level, as foundational for a just society. Taking this understanding of reciprocity into consideration, it becomes clear that HRI cannot achieve this bidirectional value of reciprocity; a robot must deceive users into believing it is capable of reciprocating to humans or is deserving of reciprocation from humans. Moreover, on the macro-level, designing social robots for reciprocity threatens the ability and willingness to reciprocate to human care workers across society. Because of these concerns, I suggest re-thinking the goals of reciprocity in social robotics. Designing for reciprocity in social robotics should be dedicated to the design of robots to enhance the ability to mutually care for those that provide us with care, as opposed to designing for reciprocity between human and robot. (shrink)

Should we grant rights to artificially intelligent robots? Most current and near-future robots do not meet the hard criteria set by deontological and utilitarian theory. Virtue ethics can avoid this problem with its indirect approach. However, both direct and indirect arguments for moral consideration rest on ontological features of entities, an approach which incurs several problems. In response to these difficulties, this paper taps into a different conceptual resource in order to be able to grant some degree of moral consideration (...) to some intelligent social robots: it sketches a novel argument for moral consideration based on social relations. It is shown that to further develop this argument we need to revise our existing ontological and social-political frameworks. It is suggested that we need a social ecology, which may be developed by engaging with Western ecology and Eastern worldviews. Although this relational turn raises many difficult issues and requires more work, this paper provides a rough outline of an alternative approach to moral consideration that can assist us in shaping our relations to intelligent robots and, by extension, to all artificial and biological entities that appear to us as more than instruments for our human purposes. (shrink)

Robots today serve in many roles, from entertainer to educator to executioner. As robotics technology advances, ethical concerns become more pressing: Should robots be programmed to follow a code of ethics, if this is even possible? Are there risks in forming emotional bonds with robots? How might society--and ethics--change with robotics? This volume is the first book to bring together prominent scholars and experts from both science and the humanities to explore these and other questions in this emerging (...) field. Starting with an overview of the issues and relevant ethical theories, the topics flow naturally from the possibility of programming robot ethics to the ethical use of military robots in war to legal and policy questions, including liability and privacy concerns. The contributors then turn to human-robot emotional relationships, examining the ethical implications of robots as sexual partners, caregivers, and servants. Finally, they explore the possibility that robots, whether biological-computational hybrids or pure machines, should be given rights or moral consideration. Ethics is often slow to catch up with technological developments. This authoritative and accessible volume fills a gap in both scholarly literature and policy discussion, offering an impressive collection of expert analyses of the most crucial topics in this increasingly important field. (shrink)

Technological developments involving robotics and artificial intelligence devices are being employed evermore in elderly care and the healthcare sector more generally, raising ethical issues and practical questions warranting closer considerations of what we mean by “care” and, subsequently, how to design such software coherently with the chosen definition. This paper starts by critically examining the existing approaches to the ethical design of care robots provided by Aimee van Wynsberghe, who relies on the work on the ethics of care by (...) Joan Tronto. In doing so, it suggests an alternative to their non-principled approach, an alternative suited to tackling some of the issues raised by Tronto and van Wynsberghe, while allowing for the inclusion of two orientative principles. Our proposal centres on the principles of autonomy and vulnerability, whose joint adoption we deem able to constitute an original revision of a bottom-up approach in care ethics. Conclusively, the ethical framework introduced here integrates more traditional approaches in care ethics in view of enhancing the debate regarding the ethical design of care robots under a new lens. (shrink)

Responsible Robotics is about developing robots in ways that take their social implications into account, which includes conceptually framing robots and their role in the world accurately. We are now in the process of incorporating robots into our world and we are trying to figure out what to make of them and where to put them in our conceptual, physical, economic, legal, emotional and moral world. How humans think about robots, especially humanoid social robots, which elicit complex and sometimes (...) disconcerting reactions, is not predetermined. The animal–robot analogy is one of the most commonly used in attempting to frame interactions between humans and robots and it also tends to push in the direction of blurring the distinction between humans and machines. We argue that, despite some shared characteristics, when it comes to thinking about the moral status of humanoid robots, legal liability, and the impact of treatment of humanoid robots on how humans treat one another, analogies with animals are misleading. (shrink)

In this paper, we theoretically address the relevance of unintentional and inconsistent interactional elements in human–robot interactions. We argue that elements failing, or poorly succeeding, to reproduce a humanlike interaction create significant consequences in human–robot relational patterns and may affect human–human relations. When considering social interactions as systems, the absence of a precise interactional element produces a general reshaping of the interactional pattern, eventually generating new types of interactional settings. As an instance of this dynamic, we study the absence of (...) metacommunicative abilities in social artifacts. Then, we analyze the pragmatic consequences of the aforementioned absence through the lens of Paul Watzlawick’s interactionist theory. We suggest that a fixed complementary interactional setting may be produced because of the asymmetric understanding, between robots and humans, of metacommunication. We highlight the psychological implications of this interactional asymmetry within Jessica Benjamin’s concept of “mutual recognition”. Finally, we point out the possible shift of dysfunctional interactional patterns from human–robot interactions to human–human ones. (shrink)

An elderly patient in a care home only wants human nurses to provide her care – not robots. If she selected her carers based on skin colour, it would be seen as racist and morally objectionable, but is choosing a human nurse instead of a robot also morally objectionable and speciesist? A plausible response is that it is not, because humans provide a better standard of care than robots do, making such a choice justifiable. In this paper, I show why (...) this response is incorrect, because robots can theoretically care as well as human nurses can. I differentiate between practical caring and emotional caring, and I argue that robots can match the standard of practical care given by human nurses, and they can simulate emotional care. There is growing evidence that people respond positively to robotic creatures and carebots, and AI software is apt to emotionally support patients in spite of the machine’s own lack of emotions. I make the case that the appearance of emotional care is sufficient, and need not be linked to emotional states within the robot. After all, human nurses undoubtedly ‘fake’ emotional care and compassion sometimes, yet their patients still feel adequately cared for. I show that it is a mistake to claim that ‘the human touch’ is in itself a contributor to a higher standard of care; ‘the robotic touch’ will suffice. Nevertheless, it is not speciesist to favour human nurses over carebots, because carebots do not suffer as the result of such a choice. (shrink)

Computers are already approving financial transactions, controlling electrical supplies, and driving trains. Soon, service robots will be taking care of the elderly in their homes, and military robots will have their own targeting and firing protocols. Colin Allen and Wendell Wallach argue that as robots take on more and more responsibility, they must be programmed with moral decision-making abilities, for our own safety. Taking a fast paced tour through the latest thinking about philosophical ethics and artificial intelligence, the authors argue (...) that even if full moral agency for machines is a long way off, it is already necessary to start building a kind of functional morality, in which artificial moral agents have some basic ethical sensitivity. But the standard ethical theories don't seem adequate, and more socially engaged and engaging robots will be needed. As the authors show, the quest to build machines that are capable of telling right from wrong has begun. -/- Moral Machines is the first book to examine the challenge of building artificial moral agents, probing deeply into the nature of human decision making and ethics. (shrink)

This paper offers an ethical framework for the development of robots as home companions that are intended to address the isolation and reduced physical functioning of frail older people with capacity, especially those living alone in a noninstitutional setting. Our ethical framework gives autonomy priority in a list of purposes served by assistive technology in general, and carebots in particular. It first introduces the notion of “presence” and draws a distinction between humanoid multi-function robots and non-humanoid robots to suggest that (...) the former provide a more sophisticated presence than the latter. It then looks at the difference between lower-tech assistive technological support for older people and its benefits, and contrasts these with what robots can offer. This provides some context for the ethical assessment of robotic assistive technology. We then consider what might need to be added to presence to produce care from a companion robot that deals with older people’s reduced functioning and isolation. Finally, we outline and explain our ethical framework. We discuss how it combines sometimes conflicting values that the design of a carebot might incorporate, if informed by an analysis of the different roles that can be served by a companion robot. (shrink)

As robots slip into more domains of human life - from the operating room to the bedroom - they take on our morally important tasks and decisions, as well as create new risks from psychological to physical. This book answers the urgent call to study their ethical, legal, and policy impacts.

There is increasing speculation within military and policy circles that the future of armed conflict is likely to include extensive deployment of robots designed to identify targets and destroy them without the direct oversight of a human operator. My aim in this paper is twofold. First, I will argue that the ethical case for allowing autonomous targeting, at least in specific restricted domains, is stronger than critics have acknowledged. Second, I will attempt to uncover, explicate, and defend the intuition that (...) even in this context there would be something ethically problematic about such targeting. I argue that an account of the non-consequentialist foundations of the principle of distinction suggests that the use of autonomous weapon systems is unethical by virtue of failing to show appropriate respect for the humanity of our enemies. However, the success of the strongest form of this argument depends upon understanding the robot itself as doing the killing. To the extent that we believe that, on the contrary, AWS are only the means whereby those who order them into action kill, the idea that the use of AWS fails to respect the humanity of our enemy will turn upon an account of what is required by respect that is essentially conventional. Thus, while the theoretical foundations of the idea that AWS are weapons that are “evil in themselves” are weaker than critics have sometimes maintained, they are nonetheless sufficient to the task of demanding a prohibition of the development and deployment of such weapons. (shrink)

In this paper I describe a future in which persons in advanced old age are cared for entirely by robots and suggest that this would be a dystopia, which we would be well advised to avoid if we can. Paying attention to the objective elements of welfare rather than to people’s happiness reveals the central importance of respect and recognition, which robots cannot provide, to the practice of aged care. A realistic appreciation of the current economics of the aged care (...) sector suggests that the introduction of robots into an aged care setting will most likely threaten rather than enhance these goods. I argue that, as a result, the development of robotics is likely to transform aged care in accordance with a trajectory of development that leads towards this dystopian future even when this is not the intention of the engineers working to develop robots for aged care. While an argument can be made for the use of robots in aged care where the people being cared for have chosen to allow robots in this role, I suggest that over-emphasising this possibility risks rendering it a self-fulfilling prophecy, depriving those being cared for of valuable social recognition, and failing to provide respect for older persons by allowing the options available to them to be shaped by the design choices of others. (shrink)

The status and functioning of shame is contested in moral psychology. In much of anglophone philosophy and psychology, it is presumed to be largely destructive, while in Confucian philosophy and many East Asian communities, it is positively associated with moral development. Recent work in human-robot interaction offers a unique opportunity to investigate how shame functions while controlling for confounding variables of interpersonal interaction. One research program suggests a Confucian strategy for using robots to rebuke participants, but results from experiments with (...) educational technologies imply a different and potentially opposing account of shame’s role in personal development. By digging deeper into the details of Confucian theorizing about shame, I identify a unifying explanation for these apparently conflicting results. I conclude by offering suggestions for future empirical research in human-robot interactions to further investigate shame’s role in moral development. (shrink)

As robots increasingly find their way into the various spheres of human life, the question of religious robots becomes relevant. This article examines from a Catholic-Christian theological perspective whether robots can be used for religious purposes, and it asks how this may be done and what issues are important to consider. In addition, the study contributes to research on the theological engagement with robotics. It is argued that the use of religious robotics dif- fers significantly depending on the (...) specific religion. From a Christian perspective, the use of religious robotics is fundamentally plausible, especially since a wide variety of entities are used as religious media or representations of the divine. However, the use of religious robotics will ultimately be decided by different concepts (e.g. human, life), religious doctrines and culturally transmitted and subjective attitudes. This article places particular focus on the design of reli- gious robotics. It becomes clear that the reasons for accepting religious technology do not lie in the technology itself but in phenomenological preferences and various time- and culture-de- pendent ideas and concepts. It is likely that as robotics rapidly advances and our relationship with it develops, the use of religious robots also will change. Puzio, Anna: Robot Theology: On Theological Engagement with Robotics and Religious Robots. In: Puzio, Anna/Kunkel, Nicole/Klinge, Hendrik (Hg.): Alexa, wie hältst du es mit der Religion? Theologische Zugänge zu Technik und Künstlicher Intelligenz (Theologie und KI 1). Darmstadt: wbg 2023, S. 95–113. DOI: 10.53186/1030373. (shrink)