Although most unmanned systems that militaries use today are still unarmed and predominantly used for surveillance, it is especially the proliferation of armed military robots that raises some serious ethical questions. One of the most pressing concerns the moral responsibility in case a military robot uses violence in a way that would normally qualify as a war crime. In this chapter, the authors critically assess the chain of responsibility with respect to the deployment of both semi-autonomous and (...) (learning) autonomous lethal military robots. They start by looking at military commanders because they are the ones with whom responsibility normally lies. The authors argue that this is typically still the case when lethal robots kill wrongly – even if these robots act autonomously. Nonetheless, they next look into the possible moral responsibility of the actors at the beginning and the end of the causal chain: those who design and manufacture armed military robots, and those who, far from the battlefield, remotely control them. (shrink)

Most unmanned systems used in operations today are unarmed and mainly used for reconnaissance and mine clearing, yet the increase of the number of armed military robots is undeniable. The use of these robots raises some serious ethical questions. For instance: who can be held morally responsible in reason when a military robot is involved in an act of violence that would normally be described as a war crime? In this article, we critically assess the attribution (...) of responsibility with respect to the deployment of both non-autonomous and non-learning autonomous lethal military robots. We will start by looking at the role of those with whom responsibility normally lies, the commanders. We argue that this is no different in the case of the above mentioned robots. After that, we will turn to those at the beginning and the end of the causal chain, respectively the manufacturers and designers, and the human operators who remotely control armed military robots from behind a computer screen. (shrink)

Using robots in the military contexts is problematic at many levels. There are social, legal, and ethical issues that should be discussed first before their wider deployment. In this paper, we focus on an additional problem: their human likeness. We claim that military robots should not look like humans. That design choice may bring additional risks that endanger human lives and by that contradicts the very justification for deploying robots at war, which is decreasing human (...) deaths and injuries. We discuss two threats—epistemological and patient. Epistemological one is connected with the risk of mistaking robots for humans due to the limited ways of getting information about the external world, which may be amplified by the rush and need to fight with robots in distance. The patient threat is related to the developing attachment to robots, that in military contexts may cause additional deaths by the hesitance to sacrifice robots in order to save humans in peril or risking human life to save robots. (shrink)

Arming uninhabited vehicles is an increasing trend. Widespread deployment can bring dangers for arms-control agreements and international humanitarian law. Armed UVs can destabilise the situation between potential opponents. Smaller systems can be used for terrorism. Using a systematic definition existing international regulation of armed UVs in the fields of arms control, export control and transparency measures is reviewed; these partly include armed UVs, but leave large gaps. For preventive arms control a general prohibition of armed UVs would be best. If (...) that is unattainable, several measures should be taken. An explicit prohibition of autonomous attack, that is without a human decision, should be added to IHL. Concerning armed UVs remotely controlled by a human soldier, recommendations differ according to type or mission. New kinds of uninhabited nuclear-weapon carriers should be banned. Space weapons should be prohibited in general. UVs smaller than 0.2–0.5 m should be banned. Bigger remotely controlled armed UVs not equipped with weapons of mass destruction should be subject to numerical limitations in various categories. For these the Treaty on Conventional Armed Forces in Europe is an important precedent. (shrink)

This article discusses mechanisms and principles for assignment of moral responsibility to intelligent robots, with special focus on military robots. We introduce the concept autonomous power as a new concept, and use it to identify the type of robots that call for moral considerations. It is furthermore argued that autonomous power, and in particular the ability to learn, is decisive for assignment of moral responsibility to robots. As technological development will lead to robots with (...) increasing autonomous power, we should be prepared for a future when people blame robots for their actions. It is important to, already today, investigate the mechanisms that control human behavior in this respect. The results may be used when designing future military robots, to control unwanted tendencies to assign responsibility to the robots. Independent of the responsibility issue, the moral quality of robots’ behavior should be seen as one of many performance measures by which we evaluate robots. How to design ethics based control systems should be carefully investigated already now. From a consequentialist view, it would indeed be highly immoral to develop robots capable of performing acts involving life and death, without including some kind of moral framework. (shrink)

Abstract This article evaluates the ?drive toward greater autonomy? in lethally-armed unmanned systems. Following a summary of the main criticisms and challenges to lethal autonomy, both engineering and ethical, raised by opponents of this effort, the article turns toward solutions or responses that defense industries and military end users might seek to incorporate in design, testing and manufacturing to address these concerns. The way forward encompasses a two-fold testing procedure for reliability incorporating empirical, quantitative benchmarks of performance in compliance (...) with formalized and programmable rules of engagement, and a conception of ?due care? in product liability. This would be designed in analogy with procedures currently followed by well-intentioned governments and militaries with their own (human) military personnel, both to ensure against failure, and to accept responsibility and compensate victims of inadvertent and unintended accidents. The procedure is designed specifically to address objections first posed by Robert Sparrow (2007) and Noel Sharkey (2007), and echoed in P.W. Singer's critically acclaimed Wired for War (2009), that lethal autonomous systems cannot be meaningfully held accountable for commission of war crimes, and thus the development, manufacture, and deployment of such systems would constitute a violation of international law. (shrink)

Ethical reflections on military robotics can be enriched by a better understanding of the nature and role of these technologies and by putting robotics into context in various ways. Discussing a range of ethical questions, this paper challenges the prevalent assumptions that military robotics is about military technology as a mere means to an end, about single killer machines, and about “military” developments. It recommends that ethics of robotics attend to how military technology changes our (...) aims, concern itself not only with individual robots but also and especially with networks and swarms, and adapt its conceptions of responsibility to the rise of such cloudy and unpredictable systems, which rely on decentralized control and buzz across many spheres of human activity. (shrink)

Central to the ethical concerns raised by the prospect of increasingly autonomous military robots are issues of responsibility. In this paper we examine different conceptions of autonomy within the discourse on these robots to bring into focus what is at stake when it comes to the autonomous nature of military robots. We argue that due to the metaphorical use of the concept of autonomy, the autonomy of robots is often treated as a black box (...) in discussions about autonomous military robots. When the black box is opened up and we see how autonomy is understood and ‘made’ by those involved in the design and development of robots, the responsibility questions change significantly. (shrink)

This article provides a detailed description of robotic weapons and unmanned systems currently used by the U.S. Military and its allies, and an ethical assessment of their actual or potential use on the battlefield. Firstly, trough a review of scientific literature, reports, and newspaper articles, a catalogue of ethical problems related to military robotics is compiled. Secondly, possible solutions for these problems are offered, by relying also on analytic tools provided by the new field of roboethics. Finally, the (...) article explores possible future developments of military robotics and present six reasons why a war between humans and automata is unlikely to happen in the 21st century. (shrink)

To deal with an uncertain future, global ethics as an academic endeavour might consider a common value we all share, such as sustainability, which acts as an all-encompassing term to indicate our future direction. Technologies of the near future that are currently in development hold problems and promise, and are clear subjects for the ethics of sustainability at a global level. Autonomous military combat robots, insects as food and in vitro synthetically grown meat are significant cases. Such (...) class='Hi'>robots might in fact serve injustice and work against sustainability, and such novel food technologies may hold hope for promoting sustainability and global justice. (shrink)

The introduction of artificial intelligence (AI) challenges much of our traditional understanding of military ethics. What virtues and what sort of ethics education are needed as we move into an ever more AI-driven military reality? In this article we suggest and discuss key virtues that are needed, including the virtue of prudence and the accompanying virtue of good and proper storytelling. We also reflect on the ideal of “explainable AI,” and philosophize about the role of fear in helping (...) us understand what is actually at stake in a military infused with AI-enabled and AI-driven weapons. (shrink)

1. Introduction 2. What honor is 3. Honor in the military 4. The use of robots and the honorableness of the military profession 5. Conclusion.

The development of autonomous, robotic weaponry is progressing rapidly. Many observers agree that banning the initiation of lethal activity by autonomous weapons is a worthy goal. Some disagree with this goal, on the grounds that robots may equal and exceed the ethical conduct of human soldiers on the battlefield. Those who seek arms-control agreements limiting the use of military robots face practical difficulties. One such difficulty concerns defining the notion of an autonomous action by a robot. Another (...) challenge concerns how to verify and monitor the capabilities of rapidly changing technologies. In this article we describe concepts from our previous work about autonomy and ethics for robots and apply them to military robots and robot arms control. We conclude with a proposal for a first step toward limiting the deployment of autonomous weapons capable of initiating lethal force. (shrink)

The United States Army’s Future Combat Systems Project, which aims to manufacture a “robot army” to be ready for deployment by 2012, is only the latest and most dramatic example of military interest in the use of artificially intelligent systems in modern warfare. This paper considers the ethics of a decision to send artificially intelligent robots into war, by asking who we should hold responsible when an autonomous weapon system is involved in an atrocity of the sort that (...) would normally be described as a war crime. A number of possible loci of responsibility for robot war crimes are canvassed; the persons who designed or programmed the system, the commanding officer who ordered its use, the machine itself. I argue that in fact none of these are ultimately satisfactory. Yet it is a necessary condition for fighting a just war, under the principle of jus in bellum, that someone can be justly held responsible for deaths that occur in the course of the war. As this condition cannot be met in relation to deaths caused by an autonomous weapon system it would therefore be unethical to deploy such systems in warfare. (shrink)

There has recently been increasing interest in the possibility and ethics of lethal autonomous weapons systems (LAWS), which would combine sophisticated AI with machinery capable of deadly force. One objection to LAWS is that their use will create a troubling responsibility gap, where no human agent can properly be held accountable for the outcomes that they create. While some authors have attempted to show that individual agents can, in fact, be responsible for the behaviour of LAWS in various circumstances, this (...) will not be possible in all cases. This article argues, however, that by assigning responsibilities to group agents operating within the military‐industrial complex, as well as the military‐industrial complex as a whole, we may be able to close the responsibility gap, or at least reduce its costs. Insofar as the potential for responsibility gaps poses an ethical barrier to the development and deployment of LAWS, this argument, if sound, may show their use to be morally permissible in a greater range of cases. (shrink)

This essay analyzes the use of military robots in terms of the jus in bello concepts of discrimination and proportionality. It argues that while robots may make mistakes, they do not suffer from most of the impairments that interfere with human judgment on the battlefield. Although robots are imperfect weapons, they can exercise as much restraint as human soldiers, if not more. Robots can be used in a way that is consistent with just war theory (...) when they are programmed to avoid using force against all but the most clearly hostile targets. However, the essay also cautions against using robots for counterinsurgency because they may alienate people in the contested area and lead to an escalation of hostilities. (shrink)

In order to present a hopefully comprehensive framework of what is the stake of the growing use of robot soldiers, the paper focuses on: the different impact of robots on legal systems, e.g., contractual obligations and tort liability; how robots affect crucial notions as causality, predictability and human culpability in criminal law and, finally, specific hypotheses of robots employed in “just wars.” By using the traditional distinction between causes that make wars just and conduct admissible on the (...) battlefield, the aim is to clarify how advancement of military robotics technology is transforming a 2,000-year-old legal debate on the concept of “just war.” For the first time, legal systems will hold political authorities and military commissioners responsible for what an artificial soldier autonomously decides to do. The paper examines how the new scenario affects both principles of military conduct and notions of justice in resorting to war. (shrink)

Robots today serve in many roles, from entertainer to educator to executioner. As robotics technology advances, ethical concerns become more pressing: Should robots be programmed to follow a code of ethics, if this is even possible? Are there risks in forming emotional bonds with robots? How might society--and ethics--change with robotics? This volume is the first book to bring together prominent scholars and experts from both science and the humanities to explore these and other questions in this (...) emerging field. Starting with an overview of the issues and relevant ethical theories, the topics flow naturally from the possibility of programming robot ethics to the ethical use of military robots in war to legal and policy questions, including liability and privacy concerns. The contributors then turn to human-robot emotional relationships, examining the ethical implications of robots as sexual partners, caregivers, and servants. Finally, they explore the possibility that robots, whether biological-computational hybrids or pure machines, should be given rights or moral consideration. Ethics is often slow to catch up with technological developments. This authoritative and accessible volume fills a gap in both scholarly literature and policy discussion, offering an impressive collection of expert analyses of the most crucial topics in this increasingly important field. (shrink)

Considerable progress is being made in robotics, with robots being developed for many different areas of life: there are service robots, industrial robots, transport robots, medical robots, household robots, sex robots, exploration robots, military robots, and many more. As robot development advances, an intriguing question arises: should robots also encompass religious functions? Religious robots could be used in religious practices, education, discussions, and ceremonies within religious buildings. This article (...) delves into two pivotal questions, combining perspectives from philosophy and religious studies: can and should robots have religious functions? Section 2 initiates the discourse by introducing and discussing the relationship between robots and religion. The core of the article (developed in Sects. 3 and 4) scrutinizes the fundamental questions: can robots possess religious functions, and should they? After an exhaustive discussion of the arguments, benefits, and potential objections regarding religious robots, Sect. 5 addresses the lingering ethical challenges that demand attention. Section 6 presents a discussion of the findings, outlines the limitations of this study, and ultimately responds to the dual research question. Based on the study’s results, brief criteria for the development and deployment of religious robots are proposed, serving as guidelines for future research. Section 7 concludes by offering insights into the future development of religious robots and potential avenues for further research. (shrink)

There is increasing speculation within military and policy circles that the future of armed conflict is likely to include extensive deployment of robots designed to identify targets and destroy them without the direct oversight of a human operator. My aim in this paper is twofold. First, I will argue that the ethical case for allowing autonomous targeting, at least in specific restricted domains, is stronger than critics have acknowledged. Second, I will attempt to uncover, explicate, and defend the (...) intuition that even in this context there would be something ethically problematic about such targeting. I argue that an account of the non-consequentialist foundations of the principle of distinction suggests that the use of autonomous weapon systems is unethical by virtue of failing to show appropriate respect for the humanity of our enemies. However, the success of the strongest form of this argument depends upon understanding the robot itself as doing the killing. To the extent that we believe that, on the contrary, AWS are only the means whereby those who order them into action kill, the idea that the use of AWS fails to respect the humanity of our enemy will turn upon an account of what is required by respect that is essentially conventional. Thus, while the theoretical foundations of the idea that AWS are weapons that are “evil in themselves” are weaker than critics have sometimes maintained, they are nonetheless sufficient to the task of demanding a prohibition of the development and deployment of such weapons. (shrink)

Computers are already approving financial transactions, controlling electrical supplies, and driving trains. Soon, service robots will be taking care of the elderly in their homes, and military robots will have their own targeting and firing protocols. Colin Allen and Wendell Wallach argue that as robots take on more and more responsibility, they must be programmed with moral decision-making abilities, for our own safety. Taking a fast paced tour through the latest thinking about philosophical ethics and artificial (...) intelligence, the authors argue that even if full moral agency for machines is a long way off, it is already necessary to start building a kind of functional morality, in which artificial moral agents have some basic ethical sensitivity. But the standard ethical theories don't seem adequate, and more socially engaged and engaging robots will be needed. As the authors show, the quest to build machines that are capable of telling right from wrong has begun. -/- Moral Machines is the first book to examine the challenge of building artificial moral agents, probing deeply into the nature of human decision making and ethics. (shrink)

Many ethicists writing about automated systems attribute agency to these systems. Not only that; they seemingly attribute an autonomous or independent form of agency to these machines. This leads some ethicists to worry about responsibility-gaps and retribution-gaps in cases where automated systems harm or kill human beings. In this paper, I consider what sorts of agency it makes sense to attribute to most current forms of automated systems, in particular automated cars and military robots. I argue that whereas (...) it indeed makes sense to attribute different forms of fairly sophisticated agency to these machines, we ought not to regard them as acting on their own, independently of any human beings. Rather, the right way to understand the agency exercised by these machines is in terms of human–robot collaborations, where the humans involved initiate, supervise, and manage the agency of their robotic collaborators. This means, I argue, that there is much less room for justified worries about responsibility-gaps and retribution-gaps than many ethicists think. (shrink)

What significance does "ethics" have for the men and women serving in the military forces of nations around the world? What core values and moral principles collectively guide the members of this "military profession?" This book explains these essential moral foundations, along with "just war theory," international relations, and international law. The ethical foundations that define the "Profession of Arms" have developed over millennia from the shared moral values, unique role responsibilities, and occasional reflection by individual members the (...) profession on their own practices - eventually coming to serve as the basis for the "Law of Armed Conflict" itself.This book focuses upon the ordinary men and women around the world who wear a military uniform and are committed to the defense of their countries and their fellow citizens. It is about what they do, how they do it, what they think about it, how they behave when carrying out their activities, and how they are expected to behave, both on and off the battlefield - and what everyone needs to know about this. The book also examines how military personnel are treated and regarded by those whom they have sworn to defend and protect, as well as how they treat and regard one another within their respective services and organizational settings. Finally, the book discusses the transformations in military professionalism occasioned by new developments in armed conflict, ranging counterinsurgency warfare and humanitarian military intervention, to cyber conflict, military robotics, and private military contracting. From China to Russia, author George Lucas effectively sheds light on today's military ethics in existence throughout the world. What Everyone Needs to Know® is a registered trademark of Oxford University Press. (shrink)

The prospect of increasingly autonomous military robots has raised concerns about the obfuscation of human responsibility. This papers argues that whether or not and to what extent human actors are and will be considered to be responsible for the behavior of robotic systems is and will be the outcome of ongoing negotiations between the various human actors involved. These negotiations are about what technologies should do and mean, but they are also about how responsibility should be interpreted and (...) how it can be best assigned or ascribed. The notion of responsibility practices, as the paper shows, provides a conceptual tool to examine these negotiations as well as the interplay between technological development and the ascription of responsibility. To illustrate the dynamics of responsibility practices the paper explores how the introduction of unmanned aerial vehicles has led to (re)negotiations about responsibility practices, focusing particularly on negotiations within the US Armed Forces. (shrink)

While in many countries the use of unmanned systems is still in its infancy, other countries, most notably the US and Israel, are much ahead. Most of the systems in operation today are unarmed and are mainly used for reconnaissance and clearing improvised explosive devices. But over the last years the deployment of armed military robots is also on the increase, especially in the air. This might make unethical behavior less likely to happen, seeing that unmanned systems are (...) immune to what are considered to be main causes of misconduct on the battlefield: frustration, boredom, and anger. The use of robots raises some ethical questions, though, and this paper attempts to give an overview of issues at stake, such as the role of emotions, civilian casualties, just war theory, and responsibility. (shrink)

I here consider the reasonableness of punishing future autonomous military robots. I argue that it is an engineering desideratum that these devices be responsive to moral considerations as well as human criticism and blame. Additionally, I argue that someday it will be possible to build such machines. I use these claims to respond to the no subject of punishment objection to deploying autonomous military robots, the worry being that an “accountability gap” could result if the robot (...) committed a war crime. (Sparrow 2007). But these robots will be blameworthy and morally responsible for their wrongful conduct. I then show that we have reasons to punish them based both on good effects and the impact on the robot, itself. (shrink)

Robert Sparrow argues that several initially plausible arguments in favor of the deployment of autonomous weapons systems (AWS) in warfare fail, and that their deployment faces a serious moral objection: deploying AWS fails to express the respect for the casualties of war that morality requires. We critically discuss Sparrow’s argument from respect and respond on behalf of some objections he considers. Sparrow’s argument against AWS relies on the claim that they are distinct from accepted weapons of war in that they (...) either fail to transmit an attitude of respect or they transmit an attitude of disrespect. We argue that this distinction between AWS and widely accepted weapons is illusory, and so cannot ground a moral difference between AWS and existing methods of waging war. We also suggest that, if deploying conventional soldiers in some situation would be permissible, and if we could expect deploying AWS to cause fewer civilian casualties, then it would be consistent with an intuitive understanding of respect to deploy AWS in this situation. (shrink)

The Laws of Armed Conflict require that war crimes be attributed to individuals who can be held responsible and be punished. Yet assigning responsibility for the actions of Lethal Autonomous Weapon...

While there are many issues to be raised in using lethal autonomous robotic weapons (beyond those of remotely operated drones), we argue that the most important question is: should the decision to take a human life be relinquished to a machine? This question is often overlooked in favor of technical questions of sensor capability, operational questions of chain of command, or legal questions of sovereign borders. We further argue that the answer must be ?no? and offer several reasons for banning (...) autonomous robots. (1) Such a robot treats a human as an object, instead of as a person with inherent dignity. (2) A machine can only mimic moral actions, it cannot be moral. (3) A machine run by a program has no human emotions, no feelings about the seriousness of killing a human. (4) Using such a robot would be a violation of military honor. We therefore conclude that the use of an autonomous robot in lethal operations should be banned. (shrink)

At a product demonstration conference in Chicago a few years ago, Taser introduced its latest technological achievement: a remote-controlled robot, developed by the iRobot company of Japan, armed with a Taser. Such a device could save lives on both sides of the law. But it is not the only use of robots replacing humans in dangerous jobs of security and defense. Recently we have seen the first robot soldiers, armed with lethal weapons, entering the battlefield as the US (...) class='Hi'>military begins to deploy remote-controlled machinegun- armed robots to patrol dangerous neighborhoods in occupied Iraq. (shrink)

The present debate over the creation and potential deployment of lethal autonomous weapons, or ‘killer robots’, is garnering more and more attention. Much of the argument revolves around whether such machines would be able to uphold the principle of noncombatant immunity. However, much of the present debate fails to take into consideration the practical realties of contemporary armed conflict, particularly generating military objectives and the adherence to a targeting process. This paper argues that we must look to the (...) targeting process if we are to gain a fuller picture of the consequences of creating or fielding lethal autonomous robots. This paper argues that once we look to how militaries actually create military objectives, and thus identify potential targets, we face an additional problem: the Strategic Robot Problem. The ability to create targeting lists using military doctrine and targeting processes is inherently strategic, and handing this capability over to a machine undermines existing comman.. (shrink)

Warfare is becoming increasingly automated, from automatic missile defense systems to micro-UAVs (WASPs) that can maneuver through urban environments with ease, and each advance brings with it ethical questions in need of resolving. Proponents of lethal autonomous weapons systems (LAWS) provide varied arguments in their favor; robots are capable of better identifying combatants and civilians, thus reducing "collateral damage"; robots need not protect themselves and so can incur more risks to protect innocents or gather more information before using (...) deadly force; robots can assess situations more quickly and do so without emotion, reducing the likelihood of fatal mistakes due to human error; and sending robots to war protects our own soldiers from harm. However, these arguments only point in favor of autonomous weapons systems, failing to demonstrate why such systems need be made *lethal*. In this paper I argue that if one grants all of the proponents' points in favor of LAWS, then, contrary to what might be expected, this leads to the conclusion that it would be both immoral and illegal to deploy *lethal* autonomous weapons, because the many features that speak in favor of them also undermine the need for them to be programmed to take lives. In particular, I argue that such systems, if lethal, would violate the moral and legal principle of necessity, which forbids the use of weapons that impose superfluous injury or unnecessary harm. I conclude by highlighting that the argument is not against autonomous weapons per se, but only against *lethal* autonomous weapons. (shrink)

P. M. Asaro: What should We Want from a Robot Ethic? G. Tamburrini: Robot Ethics: A View from the Philosophy of Science B. Becker: Social Robots - Emotional Agents: Some Remarks on Naturalizing Man-machine Interaction E. Datteri, G. Tamburrini: Ethical Reflections on Health Care Robotics P. Lin, G. Bekey, K. Abney: Robots in War: Issues of Risk and Ethics J. Altmann: Preventive Arms Control for Uninhabited Military Vehicles J. Weber: Robotic warfare, Human Rights & The Rhetorics of (...) Ethical Machines T. Nishida: Towards Robots with Good Will R. Capurro: Ethics and Robotics. (shrink)

Currently, the central questions in the philosophical debate surrounding the ethics of automated warfare are (1) Is the development and use of autonomous lethal robotic systems for military purposes consistent with (existing) international laws of war and received just war theory?; and (2) does the creation and use of such machines improve the moral caliber of modern warfare? However, both of these approaches have significant problems, and thus we need to start exploring alternative approaches. In this paper, I ask (...) whether autonomous robots ought to be programmed to be pacifists. The answer arrived at is “Yes”, if we decide to create autonomous robots, they ought to be pacifists. This is to say that robots ought not to be programmed to willingly and intentionally kill human beings, or, by extension, participate in or promote warfare, as something that predictably involves the killing of humans. Insofar as we are the ones that will be determining the content of the robot’s value system, then we ought to program robots to be pacifists, rather than ‘warists’. This is (in part) because we ought to be pacifists, and creating and programming machines to be “autonomous lethal robotic systems” directly violates this normative demand on us. There are no mitigating reasons to program lethal autonomous machines to contribute to or participate in warfare. Even if the use of autonomous lethal robotic systems could be consistent with received just war theory and the international laws of war, and even if their involvement could make warfare less inhumane in certain ways, these reasons do not compensate for the ubiquitous harms characteristic of modern warfare. In this paper, I provide four main reasons why autonomous robots ought to be pacifists, most of which do not depend on the truth of pacifism. The strong claim being argued for here is that automated warfare ought not to be pursued. The weaker claim being argued for here is that automated warfare ought not to be pursued, unless it is the most pacifist option available at the time, and other alternatives have been reasonably explored, and we are simultaneously promoting a (long term) pacifist agenda in (many) other ways. Thus, the more ambitious goal of this paper is to convince readers that automated warfare is something that we ought not to promote or pursue, while the more modest—and I suspect, more palatable—goal is to spark sustained critical discussion about the assumptions underlying the drive towards automated warfare, and to generate legitimate consideration of its pacifist alternatives,in theory, policy, and practice. (shrink)

Unmanned systems in military applications will often play a role in determining the success or failure of combat missions and thus in determining who lives and dies in times of war. Designers of UMS must therefore consider ethical, as well as operational, requirements and limits when developing UMS. I group the ethical issues involved in UMS design under two broad headings, Building Safe Systems and Designing for the Law of Armed Conflict, and identify and discuss a number of issues (...) under each of these headings. As well as identifying issues, I offer some analysis of their implications and how they might be addressed. (shrink)

Telerobotically operated and semiautonomous machines have become a major component in the arsenals of industrial nations around the world. By the year 2015 the United States military plans to have one-third of their combat aircraft and ground vehicles robotically controlled. Although there are many reasons for the use of robots on the battlefield, perhaps one of the most interesting assertions are that these machines, if properly designed and used, will result in a more just and ethical implementation of (...) warfare. This paper will focus on these claims by looking at what has been discovered about the capability of humans to behave ethically on the battlefield, and then comparing those findings with the claims made by robotics researchers that their machines are able to behave more ethically on the battlefield than human soldiers. Throughout the paper we will explore the philosophical critique of this claim and also look at how the robots of today are impacting our ability to fight wars in a just manner. (shrink)

In this study, we analyse the public perception of military AI in Estonia, a techno-optimistic country with high support for science and technology. This study involved quantitative survey data from 2021 on the public’s attitudes towards AI-based technology in general, and AI in developing and using weaponised unmanned ground systems (UGS) in particular. UGS are a technology that has been tested in militaries in recent years with the expectation of increasing effectiveness and saving manpower in dangerous military tasks. (...) However, developing weaponised systems often raises questions about their safety and accountability. While there have been public debates about the possible outcomes of AI-based civilian technologies like self-driving cars, equivalent discussions have not been held about military technologies. A discourse on potentially sensitive technologies can diminish biased representations and the distribution of worst-case scenarios. The results of this study reveal that an overall positive attitude towards AI-driven technologies is related to a positive perception of military AI systems. However, trustworthiness and human control are the main aspects that are expected from military technologies. (shrink)

Emerging technologies like robotics for war and peace stress our moral norms and generate much public interest and controversy. We use this interest to attract participants to an innovative on-line survey platform, designed for experimenting with public engagement in the ethics of technology. In particular, the N-Reasons platform addresses several issues in democratic ethics: the cost of public participation, the methodological issue of feasible reflective ethical equilibrium (how can individuals in a large group, take into account the ethical views of (...) all others?), and the reliability of public participation processes. We sketch the motivation and design of the N-Reasons platform, stressing the need for a practical (fast, low-cost) instrument that makes equilibrium feasible. We focus on the Robot Ethics Survey that featured a set of nine ethical challenges raised by robotics for war and peace. Over 400 people in five disjoint groups participated in this on-line survey experiment. We analyze the results, both quantitatively and qualitatively, the participants’ decisions taken and the reasons supporting these decisions. Both decisions and reasons strongly distinguished lethal military robotics from peace-related robotics. Methodologically, both decisions and reasons over five distinct groups were remarkably consistent. (shrink)

In this article, I shall examine some of the issues and questions involved in the technology of autonomous robots, a technology that has developed greatly and is advancing rapidly. I shall do so with reference to a particularly critical field: autonomous military robotic systems. In recent times, various issues concerning the ethical implications of these systems have been the object of increasing attention from roboticists, philosophers and legal experts. The purpose of this paper is not to deal with (...) these issues, but to show how the autonomy of those robotic systems, by which I mean the full automation of their decision processes, raises difficulties and also paradoxes that are not easy to solve. This is especially so when considering the autonomy of those robotic systems in their decision processes alongside their reliability. Finally, I would like to show how difficult it is to respond to these difficulties and paradoxes by calling into play a strong formulation of the precautionary principle. (shrink)

This paper argues that it is permissible for computer scientists and engineers—working with advanced militaries that are making good faith efforts to follow the laws of war—to engage in the research and development of lethal autonomous weapons systems. Research and development into a new weapons system is permissible if and only if the new weapons system can plausibly generate a superior risk profile for all morally relevant classes and it is not intrinsically wrong. The paper then suggests that these conditions (...) are satisfied by at least some potential LAWS development programs. More specifically, since LAWS will lead to greater force protection, warfighters are free to become more risk-acceptant in protecting civilian lives and property. Further, various malicious motivations that lead to war crimes will not apply to LAWS or will apply to no greater extent than with human warfighters. Finally, intrinsic objections—such as the claims that LAWS violate human dignity or that it creates ‘responsibility gaps’—are rejected on the basis that they rely upon implausibly idealized and atomized understandings of human decision-making in combat. (shrink)

Abstract Semi-autonomous robotic weapons are already carving out a role for themselves in modern warfare. Recently, Ronald Arkin has argued that autonomous lethal robotic systems could be more ethical than humans on the battlefield, and that this marks a significant reason in favour of their development and use. Here I offer a critical response to the position advanced by Arkin. Although I am sympathetic to the spirit of the motivation behind Arkin's project and agree that if we decide to develop (...) and use these machines they ought to be programmed to behave ethically, there are several major problems with his view as it stands. At present, it is not clear whether such machines would be capable of behaving more ethically than humans. More importantly, to the extent that humans would remain in the context of war, human moral transgressions will continue, especially in the face of complicated ethical challenges accompanying automated warfare. Moreover, even if machines could be more ethical than humans in certain ways and in certain situations, this says nothing about whether warfare that contains these machines would itself be overall more ethical than warfare that does not include them as participants, or whether the inclusion of lethal robots is the best way to guard against human moral transgressions in war. (shrink)

This paper makes the case for arms control regimes to govern the development and deployment of autonomous weapon systems and long range uninhabited aerial vehicles.

The question of whether new rules or regulations are required to govern, restrict, or even prohibit the use of autonomous weapon systems has been the subject of debate for the better part of a decade. Despite the claims of advocacy groups, the way ahead remains unclear since the international community has yet to agree on a specific definition of Lethal Autonomous Weapon Systems and the great powers have largely refused to support an effective ban. In this vacuum, the public has (...) been presented with a heavily one-sided view of Killer Robots. This interdisciplinary volume presents a more nuanced approach to autonomous weapon systems that recognizes the need to progress beyond a discourse framed by the Terminator and HAL 9000. Re-shaping the discussion around this emerging military innovation requires a new line of thought and a willingness to challenge the orthodoxy. Lethal Autonomous Weapons focuses on exploring the moral and legal issues associated with the design, development and deployment of lethal autonomous weapons. The volume brings together some of the most prominent academics and academic-practitioners in the lethal autonomous weapons space and seeks to return some balance to the debate. As part of this effort, it recognizes that society needs to invest in hard conversations that tackle the ethics, morality, and law of these new digital technologies and understand the human role in their creation and operation. (shrink)

Artificial intelligence and robotics is pervasive in daily life and set to expand to new levels potentially replacing human decision-making and action. Self-driving cars, home and healthcare robots, and autonomous weapons are some examples. A distinction appears to be emerging between potentially benevolent civilian uses of the technology (eg unmanned aerial vehicles delivering medicines), and potentially malevolent military uses (eg lethal autonomous weapons killing human com- batants). Machine-mediated human interaction challenges the philosophical basis of human existence and ethical (...) conduct. Aside from technical challenges of ensuring ethical conduct in artificial intelligence and robotics, there are moral questions about the desirability of replacing human functions and the human mind with such technology. How will artificial intelligence and robotics engage in moral reasoning in order to act ethically? Is there a need for a new set of moral rules? What happens to human interaction when it is mediated by technology? Should such technology be used to end human life? Who bears responsibility for wrongdoing or harmful conduct by artificial intelligence and robotics? -/- Whilst Kant may be familiar to international lawyers for setting restraints on the use of force and rules for perpetual peace, his foundational work on ethics provides an inclusive moral philosophy for assessing ethical conduct of individuals and states and, thus, is relevant to discussions on the use and development of artificial intelligence and robotics. His philosophy is inclusive because it incorporates justifications for morals and legitimate responses to immoral conduct, and applies to all human agents irrespective of whether they are wrongdoers, unlawful combatants, or unjust enemies. Humans are at the centre of rational thinking, action, and norm-creation so that the rationale for restraints on methods and means of warfare, for example, is based on preserving human dignity as well as ensuring conditions for perpetual peace among states. Unlike utilitarian arguments which favour use of autonomous weapons on the basis of cost-benefit reasoning or the potential to save lives, Kantian ethics establish non-consequentialist and deontological rules which are good in themselves to follow and not dependent on expediency or achieving a greater public good. -/- Kantian ethics make two distinct contributions to the debate. First, they provide a human-centric ethical framework whereby human exist- ence and capacity are at the centre of a norm-creating moral philosophy guiding our understanding of moral conduct. Second, the ultimate aim of Kantian ethics is practical philosophy that is relevant and applicable to achieving moral conduct. -/- I will seek to address the moral questions outlined above by exploring how core elements of Kantian ethics relate to use of artificial intelli- gence and robotics in the civilian and military spheres. Section 2 sets out and examines core elements of Kantian ethics: the categorical imperative; autonomy of the will; rational beings and rational thinking capacity; and human dignity and humanity as an end in itself. Sections 3-7 consider how these core elements apply to artificial intelligence and robotics with discussion of fully autonomous and human-machine rule-generating approaches; types of moral reasoning; the difference be- tween ‘human will’ and ‘machine will’; and respecting human dignity. (shrink)

In “Robots, Trust and War” Simpson claims that victory in counter-insurgency conflicts requires that military forces and their governing body win the ‘hearts and minds’ of civilians. Consequently, forces made up primarily of autonomous robots would be ineffective in these conflicts for two reasons. Firstly, because civilians cannot rationally trust them because they cannot act from a motive based on good character. If they ever did develop this capacity then the purpose of sending them to war in (...) our stead would be lost because there would be no moral saving. Secondly, because if robot forces did offer a moral saving then this would signal that the deploying government could not be trusted to be committed to the conflict. I disagree with both claims. I argue firstly that there are less demanding grounds that could allow robot forces to be trusted sufficiently to be effective whilst still achieving a moral saving over the deployment of human ones. Secondly, that this moral saving would not necessarily signal that the deploying body lacked commitment because its interpretation would be highly context-dependent. I conclude therefore, contra-Simpson, that robot forces could plausibly be effective in counter-insurgency engagements in the foreseeable future. I suggest therefore that there may be a case for developing a more finely grained understanding of the opportunities for, and challenges of, their use. (shrink)

Prior research has demonstrated that trust in robots and performance of robots are two important factors that influence human–autonomy teaming. However, other factors may influence users’ perceptions and use of autonomous systems, such as perceived intent of robots and decision authority of the robots. The current study experimentally examined participants’ trust in an autonomous security robot (ASR), perceived trustworthiness of the ASR, and desire to use an ASR that varied in levels of decision authority and benevolence. (...) Participants (N = 340) were recruited from Amazon Mechanical Turk. Results revealed the participants had increased trust in the ASR when the robot was described as having benevolent intent compared to self-protective intent. There were several interactions between decision authority and intent when predicting the trust process, showing that intent may matter the most when the robot has discretion on executing that intent. Participants stated a desire to use the ASR in a military context compared to a public context. Implications for this research demonstrate that as robots become more prevalent in jobs paired with humans, factors such as transparency provided for the robot's intent and its decision authority will influence users’ trust and trustworthiness. (shrink)

Business, management, and business ethics literature pay little attention to the topic of AI robots. The broad spectrum of potential ethical issues pertains to using driverless cars, AI robots in care homes, and in the military, such as Lethal Autonomous Weapon Systems. However, there is a scarcity of in-depth theoretical, methodological, or empirical studies that address these ethical issues, for instance, the impact of morality and where accountability resides in AI robots’ use. To address this dearth, (...) this study offers a conceptual framework that interpretively develops the ethical implications of AI robot applications, drawing on descriptive and normative ethical theory. The new framework elaborates on how the locus of morality and moral intensity combine within context-specific AI robot applications, and how this might influence accountability thinking. Our theorization indicates that in situations of escalating AI agency and situational moral intensity, accountability is widely dispersed between actors and institutions. ‘Accountability clusters’ are outlined to illustrate interrelationships between the locus of morality, moral intensity, and accountability and how these invoke different categorical responses: illegal, immoral, permissible, and supererogatory pertaining to using AI robots. These enable discussion of the ethical implications of using AI robots, and associated accountability challenges for a constellation of actors—from designer, individual/organizational users to the normative and regulative approaches of industrial/governmental bodies and intergovernmental regimes. (shrink)

Prior research has demonstrated that trust in robots and performance of robots are two important factors that influence human–autonomy teaming. However, other factors may influence users’ perceptions and use of autonomous systems, such as perceived intent of robots and decision authority of the robots. The current study experimentally examined participants’ trust in an autonomous security robot (ASR), perceived trustworthiness of the ASR, and desire to use an ASR that varied in levels of decision authority and benevolence. (...) Participants (N = 340) were recruited from Amazon Mechanical Turk. Results revealed the participants had increased trust in the ASR when the robot was described as having benevolent intent compared to self-protective intent. There were several interactions between decision authority and intent when predicting the trust process, showing that intent may matter the most when the robot has discretion on executing that intent. Participants stated a desire to use the ASR in a military context compared to a public context. Implications for this research demonstrate that as robots become more prevalent in jobs paired with humans, factors such as transparency provided for the robot's intent and its decision authority will influence users’ trust and trustworthiness. (shrink)