Recently at the J. Craig Venter Institute, a microorganism has been created through synthetic biology. In the future, more complex living beings will very probably be produced. In our natural environment, we live amongst a whole variety of beings. Some of them have moral status — they have a moral importance and we cannot treat them in just any way we please —; some do not. When it becomes possible to create artificially living beings who naturally possess (...) moral status, will this artificiality modify their status? Many people contend that it will, but I am not of the same mind and will develop three arguments against it. (shrink)

One of the objectives in the field of artificial intelligence for some decades has been the development of artificial agents capable of coexisting in harmony with people and other systems. The computing research community has made efforts to design artificial agents capable of doing tasks the way people do, tasks requiring cognitive mechanisms such as planning, decision-making, and learning. The application domains of such software agents are evident nowadays. Humans are experiencing the inclusion of artificial agents (...) in their environment as unmanned vehicles, intelligent houses, and humanoid robots capable of caring for people. In this context, research in the field of machine ethics has become more than a hot topic. Machine ethics focuses on developing ethical mechanisms for artificial agents to be capable of engaging in moral behavior. However, there are still crucial challenges in the development of truly Artificial Moral Agents. This paper aims to show the current status of Artificial Moral Agents by analyzing models proposed over the past two decades. As a result of this review, a taxonomy to classify Artificial Moral Agents according to the strategies and criteria used to deal with ethical problems is proposed. The presented review aims to illustrate (1) the complexity of designing and developing ethical mechanisms for this type of agent, and (2) that there is a long way to go (from a technological perspective) before this type of artificial agent can replace human judgment in difficult, surprising or ambiguous moral situations. (shrink)

The suggestion has been made that future advanced artificial intelligence (AI) that passes some consciousness-related criteria should be treated as having moral status, and therefore, humans would have an ethical obligation to consider its well-being. In this paper, the author discusses the extent to which software and robots already pass proposed criteria for consciousness; and argues against the moral status for AI on the grounds that human malware authors may design malware to fake consciousness. In (...) fact, the article warns that malware authors have stronger incentives than do authors of legitimate software to create code that passes some of the criteria. Thus, code that appears to be benign, but is in fact malware, might become the most common form of software to be treated as having moral status. (shrink)

Some authors have recently suggested that it is time to consider rights for robots. These suggestions are based on the claim that the question of robot rights should not depend on a standard set of conditions for ‘moral status’; but instead, the question is to be framed in a new way, by rejecting the is/ought distinction, making a relational turn, or assuming a methodological behaviourism. We try to clarify these suggestions and to show their highly problematic consequences. While (...) we find the suggestions ultimately unmotivated, the discussion shows that our epistemic condition with respect to the moral status of others does raise problems, and that the human tendency to empathise with things that do not have moral status should be taken seriously—we suggest that it produces a “derived moral status”. Finally, it turns out that there is typically no individual in real AI that could even be said to be the bearer of moral status. Overall, there is no reason to think that robot rights are an issue now. (shrink)

This book considers the question: to what extent does it make sense to qualify technical artefacts as moral entities? The authors’ contributions trace recent proposals and topics including instrumental and non-instrumental values of artefacts, agency and artefactual agency, values in and around technologies, and the moral significance of technology. The editors’ introduction explains that as ‘agents’ rather than simply passive instruments, technical artefacts may actively influence their users, changing the way they perceive the world, the way they act (...) in the world and the way they interact with each other. This volume features the work of various experts from around the world, representing a variety of positions on the topic. Contributions explore the contested discourse on agency in humans and artefacts, defend the Value Neutrality Thesis by arguing that technological artefacts do not contain, have or exhibit values, or argue that moral agency involves both human and non-human elements. The book also investigates technological fields that are subject to negative moral valuations due to the harmful effects of some of their products. It includes an analysis of some difficulties arising in Artificial Intelligence and an exploration of values in Chemistry and in Engineering. The Moral Status of Technical Artefacts is an advanced exploration of the various dimensions of the relations between technology and morality. (shrink)

The chief themes of this discussion are as follows. First, we need a theory of the grounds of moral status that could guide practical considerations regarding how to treat the wide range of potentially conscious entities with which we are acquainted – injured humans, cerebral organoids, chimeras, artificially intelligent machines, and non-human animals. I offer an account of phenomenal value that focuses on the structure and sophistication of phenomenally conscious states at a time and over time in the (...) mental lives of conscious subjects. Second, we need to map a theory of moral status onto practical considerations. I prefer the precautionary framework proposed by many, and fruitfully precisified recently by Birch. I have suggested that in addition to further discussion surrounding the evidential bar for attributing consciousness to different types of entities, more discussion is needed regarding how value and moral status may vary across different entity-types, and regarding the sources of value in an entity’s mental life. (shrink)

The inquiry into the moral status of artificial intelligence (AI) is leading to prolific theoretical discussions. A new entity that does not share the material substrate of human beings begins to show signs of a number of properties that are nuclear to the understanding of moral agency. It makes us wonder whether the properties we associate with moral status need to be revised or whether the new artificial entities deserve to enter within the (...) circle of moral consideration. This raises the foreboding that we are at the gates of an anthropological crisis: the properties bound to moral agency have been exclusively possessed in the past by human beings and have shaped the very definition of being human. In this article, I will argue that AI does not lead us to an anthropological crisis and that, if we adhere to the history and philosophy of technology, we will notice that the debate on the moral status of AI uncritically starts from an anthropology of properties and loses sight of the relational dimension of technology. First, I will articulate three criteria for analyzing different anthropological views in philosophy of technology. Second, I will propose six anthropological models: traditional, industrial, phenomenological, postphenomenological, symmetrical, and cyborg. Third, I will show how the emergence of AI breaks with the dynamics of increased relationality in the history and philosophy of technology. I will argue that this aspect is central to debates about the moral status of AI, since it sheds light on an aspect of moral consideration that has been obscured. Finally, I will reject entirely relational approaches to moral status and propose two hybrid possibilities for rethinking it. (shrink)

This chapter contains sections titled: What is Moral Status? The Moral Agency Theory The Genetic Humanity Theory The Sentience Theory The Organic Life Theory Two Relationship‐based Theories Combining these Criteria Principles of Moral Status Human Zygotes, Embryos, and Fetuses Are All Animals Equal? Machines and Artificial Life‐forms Conclusion.

Consciousness-based approaches to non-human moral status maintain that consciousness is necessary for (some degree or level of) moral status. While these approaches are intuitive to many, in this paper I argue that the judgment that consciousness is necessary for moral status is not secure enough to guide policy regarding non-humans, that policies responsive to the moral status of non-humans should take seriously the possibility that psychological features independent of consciousness are sufficient for (...) moral status. Further, I illustrate some practical consequences of calling consciousness-based views into question. (shrink)

Floridi and Sanders, seminal work, “On the morality of artificial agents” has catalyzed attention around the moral status of computer systems that perform tasks for humans, effectively acting as “artificial agents.” Floridi and Sanders argue that the class of entities considered moral agents can be expanded to include computers if we adopt the appropriate level of abstraction. In this paper we argue that the move to distinguish levels of abstraction is far from decisive on this (...) issue. We also argue that adopting certain levels of abstraction out of context can be dangerous when the level of abstraction obscures the humans who constitute computer systems. We arrive at this critique of Floridi and Sanders by examining the debate over the moral status of computer systems using the notion of interpretive flexibility. We frame the debate as a struggle over the meaning and significance of computer systems that behave independently, and not as a debate about the ‘true’ status of autonomous systems. Our analysis leads to the conclusion that while levels of abstraction are useful for particular purposes, when it comes to agency and responsibility, computer systems should be conceptualized and identified in ways that keep them tethered to the humans who create and deploy them. (shrink)

In this paper, we defend three claims about what it will take for an AI system to be a basic moral patient to whom we can owe duties of non-maleficence not to harm her and duties of beneficence to benefit her: (1) Moral patients are mental patients; (2) Mental patients are true intentional systems; and (3) True intentional systems are systematically flexible. We suggest that we should be particularly alert to the possibility of such systematically flexible true intentional (...) systems developing in the areas of exploratory robots and artificial personal assistants. Finally, we argue that in light of our failure to respect the well-being of existing biological moral patients and worries about our limited resources, there are compelling moral reasons to treat artificial moral patiency as something to be avoided at least for now. (shrink)

While philosophers have been debating for decades on whether different entities—including severely disabled human beings, embryos, animals, objects of nature, and even works of art—can legitimately be considered as having moral status, this question has gained a new dimension in the wake of artificial intelligence (AI). One of the more imminent concerns in the context of AI is that of the moral rights and status of social robots, such as robotic caregivers and artificial companions, (...) that are built to interact with human beings. In recent years, some approaches to moral consideration have been proposed that would include social robots as proper objects of moral concern, even though it seems unlikely that these machines are conscious beings. In the present paper, I argue against these approaches by advocating the “consciousness criterion,” which proposes phenomenal consciousness as a necessary condition for accrediting moral status. First, I explain why it is generally supposed that consciousness underlies the morally relevant properties (such as sentience) and then, I respond to some of the common objections against this view. Then, I examine three inclusive alternative approaches to moral consideration that could accommodate social robots and point out why they are ultimately implausible. Finally, I conclude that social robots should not be regarded as proper objects of moral concern unless and until they become capable of having conscious experience. While that does not entail that they should be excluded from our moral reasoning and decision-making altogether, it does suggest that humans do not owe direct moral duties to them. (shrink)

Is it OK to lie to Siri? Is it bad to mistreat a robot for our own pleasure? Under what condition should we grant a moral status to an artificial intelligence (AI) system? This paper looks at different arguments for granting moral status to an AI system: the idea of indirect duties, the relational argument, the argument from intelligence, the arguments from life and information, and the argument from sentience. In each but the last case, (...) we find unresolved issues with the particular argument, which leads us to move to a different one. We leave the idea of indirect duties aside since these duties do not imply considering an AI system for its own sake. The paper rejects the relational argument and the argument from intelligence. The argument from life may lead us to grant a moral status to an AI system, but only in a weak sense. Sentience, by contrast, is a strong argument for the moral status of an AI system—based, among other things, on the Aristotelian principle of equality: that same cases should be treated in the same way. The paper points out, however, that no AI system is sentient given the current level of technological development. (shrink)

Thanks to mounting discussion about projected technologies’ possibly altering the species mentally and physically, philosophical investigation of what human beings are proceeds robustly. Many thinkers contend that whatever we are has little to do with how we should behave. Yet, tampering with what the human being is may tread upon human rights to be whatever one is. Rights given in widely recognized documents such as the U.N. Declaration of the Rights of Indigenous Peoples assume what humans are and need depends (...) upon ontological assumptions about human existence. Godman turns to human ontology—just what kind of beings humans are (from an angle distinct from the other two books) and how these play into rights. She is concerned with how well the social sciences accord with what we are. Gunkel homes in on a more specific moral topic than Godman's general concern with identity’s role in rights: automata moral status and rights. He enjoins us to inquire into what human rights are before we take on the new technologies’ challenge to it. Schneider’s Artificial You, while not explicitly about rights, poses a rights quandary. Certain individuals with reputable resources and practical backing explicitly seek to evolve the species as they see fit. The urgency among these works concerns how we need a sharper idea of what we are, how we should act and be treated, and how our rights fare among potential human improvements. (shrink)

This paper considers the hotly debated issue of whether one should grant moral and legal personhood to intelligent robots once they have achieved a certain standard of sophistication based on such criteria as rationality, autonomy, and social relations. The starting point for the analysis is the European Parliament’s resolution on Civil Law Rules on Robotics and its recommendation that robots be granted legal status and electronic personhood. The resolution is discussed against the background of the so-called Robotics Open (...) Letter, which is critical of the Civil Law Rules on Robotics. The paper reviews issues related to the moral and legal status of intelligent robots and the notion of legal personhood, including an analysis of the relation between moral and legal personhood in general and with respect to robots in particular. It examines two analogies, to corporations and animals, that have been proposed to elucidate the moral and legal status of robots. The paper concludes that one should not ascribe moral and legal personhood to currently existing robots, given their technological limitations, but that one should do so once they have achieved a certain level at which they would become comparable to human beings. (shrink)

Is it OK to lie to Siri? Is it bad to mistreat a robot for our own pleasure? Under what condition should we grant a moral status to an artificial intelligence system? This paper looks at different arguments for granting moral status to an AI system: the idea of indirect duties, the relational argument, the argument from intelligence, the arguments from life and information, and the argument from sentience. In each but the last case, we (...) find unresolved issues with the particular argument, which leads us to move to a different one. We leave the idea of indirect duties aside since these duties do not imply considering an AI system for its own sake. The paper rejects the relational argument and the argument from intelligence. The argument from life may lead us to grant a moral status to an AI system, but only in a weak sense. Sentience, by contrast, is a strong argument for the moral status of an AI system—based, among other things, on the Aristotelian principle of equality: that same cases should be treated in the same way. The paper points out, however, that no AI system is sentient given the current level of technological development. (shrink)

According to the most popular theories of intentionality, a family of theories we will refer to as “functional intentionality,” a machine can have genuine intentional states so long as it has functionally characterizable mental states that are causally hooked up to the world in the right way. This paper considers a detailed description of a robot that seems to meet the conditions of functional intentionality, but which falls victim to what I call “the composition problem.” One obvious way to escape (...) the problem (arguably, the only way) is if the robot can be shown to be a moral patient – to deserve a particular moral status. If so, it isn’t clear how functional intentionality could remain plausible (something like “phenomenal intentionality” would be required). Finally, while it would have seemed that a reasonable strategy for establishing the moral status of intelligent machines would be to demonstrate that the machine possessed genuine intentionality, the composition argument suggests that the order of precedence is reversed: The machine must first be shown to possess a particular moral status before it is a candidate for having genuine intentionality. (shrink)

The emergence of AI is posing serious challenges to standard conceptions of moral status. New non-biological entities are able to act and make decisions rationally. The question arises, in this regard, as to whether AI systems possess or can possess the necessary properties to be morally considerable. In this chapter, we have undertaken a systematic analysis of the various debates that are taking place about the moral status of AI. First, we have discussed the possibility that (...) AI systems, by virtue of its new agential capabilities, can be understood as a moral agent. Discussions between those defending mentalist and anti-mentalist positions have revealed many nuances and particularly relevant theoretical aspects. Second, given that an AI system can hardly be an entity qualified to be responsible, we have delved into the responsibility gap and the different ways of understanding and addressing it. Third, we have provided an overview of the current and potential patientist capabilities that AI systems possess. This has led us to analyze the possibilities of AI possessing moral patiency. In addition, we have addressed the question of the moral and legal rights of AI. Finally, we have introduced the two most relevant authors of the relational turn on the moral status of AI, Mark Coeckelbergh and David Gunkel, who have been led to defend a relational approach to moral life as a result of the problems associated with the ontological understanding of moral status. (shrink)

Henry Shevlin’s paper—“How could we know when a robot was a moral patient?” – argues that we should recognize robots and artificial intelligence (AI) as psychological moral patients if they are cognitively equivalent to other beings that we already recognize as psychological moral patients (i.e., humans and, at least some, animals). In defending this cognitive equivalence strategy, Shevlin draws inspiration from the “behavioral equivalence” strategy that I have defended in previous work but argues that it is (...) flawed in crucial respects. Unfortunately—and I guess this is hardly surprising—I cannot bring myself to agree that the cognitive equivalence strategy is the superior one. In this article, I try to explain why in three steps. First, I clarify the nature of the question that I take both myself and Shevlin to be answering. Second, I clear up some potential confusions about the behavioral equivalence strategy, addressing some other recent criticisms of it. Third, I will explain why I still favor the behavioral equivalence strategy over the cognitive equivalence one. (shrink)

In light of recent breakneck pace in machine learning, questions about whether near-future artificial systems might be conscious and possess moral status are increasingly pressing. This paper argues that as matters stand these debates lack any clear criteria for resolution via the science of consciousness. Instead, insofar as they are settled at all, it is likely to be via shifts in public attitudes brought about by the increasingly close relationships between humans and AI users. Section 1 of (...) the paper I briefly lays out the current state of the science of consciousness and its limitations insofar as these pertain to machine consciousness, and claims that there are no obvious consensus frameworks to inform public opinion on AI consciousness. Section 2 examines the rise of conversational chatbots or Social AI, and argues that in many cases, these elicit strong and sincere attributions of consciousness, mentality, and moral status from users, a trend likely to become more widespread. Section 3 presents an inconsistent triad for theories that attempt to link consciousness, behaviour, and moral status, noting that the trends in Social AI systems will likely make the inconsistency of these three premises more pressing. Finally, Section 4 presents some limited suggestions for how consciousness and AI research communities should respond to the gap between expert opinion and folk judgment. (shrink)

This article focuses on a particular issue under machine ethics—that is, the nature of Artificial Moral Agents. Machine ethics is a branch of artificial intelligence that looks into the moral status of artificial agents. Artificial moral agents, on the other hand, are artificial autonomous agents that possess moral value, as well as certain rights and responsibilities. This paper demonstrates that attempts to fully develop a theory that could possibly account for (...) the nature of Artificial Moral Agents may consider certain philosophical ideas, like the standard characterizations of agency, rational agency, moral agency, and artificial agency. At the very least, the said philosophical concepts may be treated as signposts for further research on how to truly account for the nature of Artificial Moral Agents. (shrink)

Corporations are moral persons to the extent that they have rights and duties, but their moral personality is severely limited. As artificial persons, they lack the emotional make-up that allows natural persons to show virtues and vices. That fact, taken with the representative function of management, places significant limitations on what constitutes ethical behavior by management. A common misunderstanding of those limitations can lead ethical managers to behave unethically and can lead the public to have improper expectations (...) of corporations. (shrink)

This paper presents a new trilemma with respect to resolving the control and alignment problems in machine ethics. Section 1 outlines three possible types of artificial moral agents (AMAs): (1) 'Inhuman AMAs' programmed to learn or execute moral rules or principles without understanding them in anything like the way that we do; (2) 'Better-Human AMAs' programmed to learn, execute, and understand moral rules or principles somewhat like we do, but correcting for various sources of human (...) class='Hi'>moral error; and (3) 'Human-Like AMAs' programmed to understand and apply moral values in broadly the same way that we do, with a human-like moral psychology. Sections 2–4 then argue that each type of AMA generates unique control and alignment problems that have not been fully appreciated. Section 2 argues that Inhuman AMAs are likely to behave in inhumane ways that pose serious existential risks. Section 3 then contends that Better-Human AMAs run a serious risk of magnifying some sources of human moral error by reducing or eliminating others. Section 4 then argues that Human-Like AMAs would not only likely reproduce human moral failures, but also plausibly be highly intelligent, conscious beings with interests and wills of their own who should therefore be entitled to similar moral rights and freedoms as us. This generates what I call the New Control Problem: ensuring that humans and Human-Like AMAs exert a morally appropriate amount of control over each other. Finally, Section 5 argues that resolving the New Control Problem would, at a minimum, plausibly require ensuring what Hume and Rawls term ‘circumstances of justice’ between humans and Human-Like AMAs. But, I argue, there are grounds for thinking this will be profoundly difficult to achieve. I thus conclude on a skeptical note. Different approaches to developing ‘safe, ethical AI’ generate subtly different control and alignment problems that we do not currently know how to adequately resolve, and which may or may not be ultimately surmountable. (shrink)

Moralna prihvatljivost kontracepcije kao metode kontrole radjanja usko je povezana s pitanjem moralnog opravdanja reproduktivne autonomije, odnosno s pitanjem treba li pojedincima dopustiti da autonomno i slobodno odlucuju o tome hoce li imati djece, kada i koliko. Razvoj medicinskih i znanstvenih tehnologija doveo je do upotrebe umjetnih metoda kontracepcije koji sprjecavaju zacece s ciljem odgadjanja i planiranja radjanja djece. U prvom dijelu clanka analiziram bioeticke argumente koji se iznose u raspravi o reproduktivnoj autonomiji, a koji bi mogli biti mobilizirani protiv (...) dopustanja upotrebe umjetne kontracepcije. U drugom dijelu, usporedjujem bioeticke argumente s daleko razradjenijim argumentima protiv umjetne kontracepcijekoji se pojavljuju u raspravama u filozofiji seksualnosti. U trecem i posljednjem dijelu, iznosim argumente protiv stavova G.E.M. Anscombe i J. Finnisa koji opravdavaju upotrebu prirodne metode kontrole radjanja, ali ne i umjetnih sredstva na nacin da ukazujem da nema moralno relevantne razlike izmedju ove dvije metode kontrole zaceca i radjanja. (shrink)

Should artificial agents (such as robots) be granted moral status? This seems like an important question to resolve, given that we will encounter a growing number of increasingly sophisticated artificial agents in the not too distant future. However, many will think that before we can even start to tackle questions about the moral status of artificial agents, we first need to solve tricky issues in the philosophy of mind. After all, most orthodox views (...) about moral status imply that only entities with a mental life are eligible for moral status. But, whether an unfamiliar entity like an artificial agent has a mental life raises controversial questions in the philosophy of mind. Given this, one might hope that we can resolve questions about the moral status of robots via “minimalist” views that give sufficient conditions for granting moral status to an entity that we can know to be satisfied without knowing whether the entity in question has a mind. This paper argues that we should be pessimistic about the prospects of minimalist views avoiding controversial questions in the philosophy of mind, by arguing that minimalist sufficient conditions are only plausible if combined with assumptions in the philosophy of mind. (shrink)

As the notion of artificial moral agency gains popularity among ethicists, it threatens the unique status of the human person as a responsible moral agent. The philosophy of ontocentrism, popularized by Luciano Floridi, argues that biocentrism is too restrictive and must yield to a new philosophical vision that endows all beings with some intrinsic value. Floridi’s macroethics also regards more sophisticated digital entities such as robots as accountable moral agents. To refute these principles, this paper (...) turns to the thought of Karol Wojtyla, who argued cogently for an intimate correlation between personal action (actus personae) and moral agency. By examining the distinguishing characteristics of personal action, we can ascertain the necessary conditions of moral agency and demonstrate why artificial entities do not meet those condi­tions. National Catholic Bioethics Quarterly 11.3 (Autumn 2011): 479–501. (shrink)

Hildt (2023) considers the topic of machine consciousness and the ethical implications of artificial entities, such as robots, possessing different forms of consciousness. Her paper recommends that...

Many controversies in bioethics turn on questions of moral status. Some moral status issues have received extensive bioethical attention, including those raised by abortion, embryo experimentation, and animal research. Beyond these established debates lie a less familiar set of moral status issues, many of which are tied to recent scientific breakthroughs. This review article surveys some key developments that raise moral status issues, including the development of in vitro brains, part-human animals, “synthetic” (...) embryos, and artificial womb technologies. It introduces the papers in this Special Issue, contextualises their contributions to the moral status literature, and highlights some enduring challenges of determining the moral status of novel types of beings. (shrink)

Empirical research on human–robot interaction has demonstrated how humans tend to react to social robots with empathic responses and moral behavior. How should we ethically evaluate such responses to robots? Are people wrong to treat non-sentient artefacts as moral patients since this rests on anthropomorphism and ‘over-identification’ —or correct since spontaneous moral intuition and behavior toward nonhumans is indicative for moral patienthood, such that social robots become our ‘Others’?. In this research paper, I weave extant HRI (...) studies that demonstrate empathic responses toward robots with the recent debate on moral status for robots, on which the ethical evaluation of moral behavior toward them is dependent. Patienthood for robots has standardly been thought to obtain on some intrinsic ground, such as being sentient, conscious, or having interest. But since these attempts neglect moral experience and are curbed by epistemic difficulties, I take inspiration from Coeckelbergh and Gunkel’s ‘relational approach’ to explore an alternative way of accounting for robot patienthood based on extrinsic premises. Based on the ethics of Danish theologian K. E. Løgstrup I argue that empathic responses can be interpreted as sovereign expressions of life and that these expressions benefit human subjects—even if they emerge from social interaction afforded by robots we have anthropomorphized. I ultimately develop an argument in defense of treating robots as moral patients. (shrink)

According to a common view, sentience is necessary and sufficient for moral status. In other words, whether a being has intrinsic moral relevance is determined by its capacity for conscious experience. The _epistemic objection_ derives from our profound uncertainty about sentience. According to this objection, we cannot use sentience as a _criterion_ to ascribe moral status in practice because we won’t know in the foreseeable future which animals and AI systems are sentient while ethical questions (...) regarding the possession of moral status are urgent. Therefore, we need to formulate an alternative criterion. I argue that the epistemic objection is dissolved once one clearly distinguishes between the question what determines moral status and what criterion should be employed in practice to ascribe moral status. Epistemic concerns are irrelevant to the former question and—I will argue—criteria of moral status have inescapably to be based on sentience, if one concedes that sentience determines moral status. It follows that doubts about our epistemic access to sentience cannot be used to motivate an alternative criterion of moral status. If sentience turns out to be unknowable, then moral status is unknowable. However, I briefly advocate against such strong pessimism. (shrink)

Moral status arguments are typically formulated as descriptive statements that tell us something about the world. But philosophy of language teaches us that language can also be used performatively: we do things with words and use words to try to get others to do things. Does and should this theory extend to what we say about moral status, and what does it mean? Drawing on Austin, Searle, and Butler and further developing relational views of moral (...) status, this article explores what it means to conceptualize moral status in a performative way and in a way that reaches deep down to its basis, proposes a distinction between strong and weak versions of this view, and discusses the implications for thinking about the moral status of humans and nonhumans. Next to contributing to theory about performativity in the moral domain in general, this effort helps to reveal, understand, and evaluate the performative dimension of utterances made in public discussions about the moral status of animals and artificial agents such as robots and artificial intelligence. (shrink)

It is widely agreed that possession of consciousness contributes to an entity’s moral status, even if it is not necessary for moral status (Levy and Savulescu 2009). An entity is considered to have...

지금까지 도덕에 관한 논의는 주로 인간과 동물 그리고 생태계에 한정되었다. 하지만 인공지능에 기반하고 있는 자율성을 가진 인공체들의 등장으로 인해 도덕적 지위에 대한 논의에 인공적 행위자가 포함되어야 한다는 주장들이 제기되고 있다. 스스로 판단하고 결정할 능력이 있는 ‘자율적인 인공시스템들’의 응용이 더 복잡해지고 더 현실적이 될수록 이와 관련한 도덕적 결정의 문제들도 더 복잡해질 것이다.BR 본 논문에서 필자는 인공적 행위자들의 도덕적 지위와 관련된 문제들의 논의를 위해 먼저 ‘행위성’과 ‘도덕적 행위성’의 개념을 드러내고, 어떤 존재가 도덕적 행위주체로 인정될 수 있는 기준들을 검토한다. 그리고 ‘인공적인 도덕행위자들(AMA)’이 이러한 (...) 기준들과 관련해서 어떤 기준을 충족시킬 수 있으며, 어느 수준의 도덕적 행위주체로 인정될 수 있는지 그 가능성을 모색할 것이다. 이를 위해 필자는 인공적 행위자들의 도덕적 지위의 기준들과 가능성을 논증하는 플로리디와 샌더스, 무어, 그리고 보스트롬과 유드코프스키의 논변들을 검토하고, 기계윤리의 가능성을 통해 도덕적 원을 인공적 행위주체들로 확장시키고자 하는 토런스의 논증에서 AMA에게 가능할 수 있는 도덕적 지위의 수준을 확인할 것이다. (shrink)

Artificial agents such as robots are performing increasingly significant ethical roles in society. As a result, there is a growing literature regarding their moral status with many suggesting it is justified to regard manufactured entities as having intrinsic moral worth. However, the question of whether artificial agents could have the high degree of moral status that is attributed to human persons has largely been neglected. To address this question, the author developed a respect-based (...) account of the ethical criteria for the moral status of persons. From this account, the paper employs an empirical test that must be passed in order for artificial agents to be considered alongside persons as having the corresponding rights and duties. (shrink)

This article explores whether and under which circumstances it is ethically viable to include artificial beings worthy of moral consideration in virtual environments. In particular, the article focuses on virtual environments such as those in digital games and training simulations – interactive and persistent digital artifacts designed to fulfill specific purposes, such as entertainment, education, training, or persuasion. The article introduces the criteria for moral consideration that serve as a framework for this analysis. Adopting this framework, the (...) article tackles the question of whether including artificial intelligences that are entitled to moral consideration in virtual environments constitutes an immoral action on the part of human creators. To address this problem, the article draws on three conceptual lenses from the philosophical branch of ethics: the problem of parenthood and procreation, the question concerning the moral status of animals, and the classical problem of evil. Using a thought experiment, the concluding section proposes a contractualist answer to the question posed in this article. The same section also emphasizes the potential need to reframe our understanding of the design of virtual environments and their future stakeholders. (shrink)

The aim of this thesis is to advance a philosophically justifiable account of Artificial Moral Agency (AMA). Concerns about the moral status of Artificial Intelligence (AI) traditionally turn on questions of whether these systems are deserving of moral concern (i.e. if they are moral patients) or whether they can be sources of moral action (i.e. if they are moral agents). On the Organic View of Ethical Status, being a moral (...) patient is a necessary condition for an entity to qualify as a moral agent. This view claims that because artificial agents (AAs) lack sentience, they cannot be proper subjects of moral concern and hence cannot be considered to be moral agents. I raise conceptual and epistemic issues with regards to the sense of sentience employed on this view, and I argue that the Organic View does not succeed in showing that machines cannot be moral patients. Nevertheless, irrespective of this failure, I also argue that the entire project is misdirected in that moral patiency need not be a necessary condition for moral agency. Moreover, I claim that whereas machines may conceivably be moral patients in the future, there is a strong case to be made that they are (or will very soon be) moral agents. Whereas it is often argued that machines cannot be agents simpliciter, let alone moral agents, I claim that this argument is predicated on a conception of agency that makes unwarranted metaphysical assumptions even in the case of human agents. Once I have established the shortcomings of this “standard account”, I move to elaborate on other, more plausible, conceptions of agency, on which some machines clearly qualify as agents. Nevertheless, the argument is still often made that while some machines may be agents, they cannot be moral agents, given their ostensible lack of the requisite phenomenal states. Against this thesis, I argue that the requirement of internal states for moral agency is philosophically unsound, as it runs up against the problem of other minds. In place of such intentional accounts of moral agency, I provide a functionalist alternative, which makes conceptual room for the existence of AMAs. The implications of this thesis are that at some point in the future we may be faced with situations for which no human being is morally responsible, but a machine may be. Moreover, this responsibility holds, I claim, independently of whether the agent in question is “punishable” or not. (shrink)

In this paper, I focus on the concept of human dignity and critically assess whether such a concept, as used in the Universal Declaration on Bioethics and Human Rights, is indeed a useful tool for bioethical debates. However, I consider this concept within the context of the development of emerging technologies, that is, with a particular focus on transhumanism. The question I address is not whether attaching artificial limbs or enhancing particular traits or capacities would dehumanize or undignify persons (...) but whether nonbiological entities introduced into or attached to the human body contribute to the “augmentation” of human dignity. First, I outline briefly how the Universal Declaration on Bioethics and Human Rights uses the concept of dignity. Second, I look at the possibility of a universal bioethics in relation to the concept of human dignity. Third, I examine the concept of posthuman dignity and whether the concept of human dignity as construed in the declaration has any relevance to posthuman dignity. (shrink)

I compare a ‘realist’ with a ‘social–relational’ perspective on our judgments of the moral status of artificial agents (AAs). I develop a realist position according to which the moral status of a being—particularly in relation to moral patiency attribution—is closely bound up with that being’s ability to experience states of conscious satisfaction or suffering (CSS). For a realist, both moral status and experiential capacity are objective properties of agents. A social relationist denies (...) the existence of any such objective properties in the case of either moral status or consciousness, suggesting that the determination of such properties rests solely upon social attribution or consensus. A wide variety of social interactions between us and various kinds of artificial agent will no doubt proliferate in future generations, and the social–relational view may well be right that the appearance of CSS features in such artificial beings will make moral role attribution socially prevalent in human–AA relations. But there is still the question of what actual CSS states a given AA is capable of undergoing, independently of the appearances. This is not just a matter of changes in the structure of social existence that seem inevitable as human–AA interaction becomes more prevalent. The social world is itself enabled and constrained by the physical world, and by the biological features of living social participants. Properties analogous to certain key features in biological CSS are what need to be present for nonbiological CSS. Working out the details of such features will be an objective scientific inquiry. (shrink)

In this paper I provide an exposition and critique of the Organic View of Ethical Status, as outlined by Torrance (2008). A key presupposition of this view is that only moral patients can be moral agents. It is claimed that because artificial agents lack sentience, they cannot be proper subjects of moral concern (i.e. moral patients). This account of moral standing in principle excludes machines from participating in our moral universe. I will (...) argue that the Organic View operationalises anthropocentric intuitions regarding sentience ascription, and by extension how we identify moral patients. The main difference between the argument I provide here and traditional arguments surrounding moral attributability is that I do not necessarily defend the view that internal states ground our ascriptions of moral patiency. This is in contrast to views such as those defended by Singer (1975, 2011) and Torrance (2008), where concepts such as sentience play starring roles. I will raise both conceptual and epistemic issues with regards to this sense of sentience. While this does not preclude the usage of sentience outright, it suggests that we should be more careful in our usage of internal mental states to ground our moral ascriptions. Following from this I suggest other avenues for further exploration into machine moral patiency which may not have the same shortcomings as the Organic View. (shrink)

In a recent article, Joshua Shepherd identifies six problems with attributing moral status to nonhumans on the basis of consciousness (Shepherd 2023). In this commentary, I want to draw out yet ano...

In this paper, I focus on the concept of human dignity and critically assess whether such a concept, as used in the Universal Declaration on Bioethics and Human Rights, is indeed a useful tool for bioethical debates. However, I consider this concept within the context of the development of emerging technologies, that is, with a particular focus on transhumanism. The question I address is not whether attaching artificial limbs or enhancing particular traits or capacities would dehumanize or undignify persons (...) but whether nonbiological entities introduced into or attached to the human body contribute to the “augmentation” of human dignity. First, I outline briefly how the Universal Declaration on Bioethics and Human Rights uses the concept of dignity. Second, I look at the possibility of a universal bioethics in relation to the concept of human dignity. Third, I examine the concept of posthuman dignity and whether the concept of human dignity as construed in the declaration has any relevance to posthuman dignity. (shrink)

In 2010, the Venter lab announced that it had created the first bacterium with an entirely synthetic genome. This was reported to be the first instance of ‘artificial life,’ and in the ethical and policy discussions that followed it was widely assumed that the creation of artificial life is in itself morally significant. We cast doubt on this assumption. First we offer an account of the creation of artificial life that distinguishes this from the derivation of organisms (...) from existing life and clarify what we mean in asking whether the creation of artificial life has moral significance. We then articulate and evaluate three attempts to establish that the creation of artificial life is morally significant. These appeal to the claim that the creation of artificial life involves playing God, as expressed in three distinct formulations; the claim that the creation of artificial life will encourage reductionist attitudes toward the living world that undermine the special moral value accorded to life; and the worry that artificial organisms will have an uncertain functional status and consequently an uncertain moral status. We argue that all three attempts to ground the moral significance of the creation of artificial life fail, because none of them establishes that the creation of artificial life is morally problematic in a way that the derivation of organisms from existing life forms is not. We conclude that the decisive moral consideration is not how life is created but what non-genealogical properties it possesses. (shrink)

The aim of this exploratory paper is to review an under-appreciated parallel between group agency and artificial intelligence. As both phenomena involve non-human goal-directed agents that can make a difference to the social world, they raise some similar moral and regulatory challenges, which require us to rethink some of our anthropocentric moral assumptions. Are humans always responsible for those entities’ actions, or could the entities bear responsibility themselves? Could the entities engage in normative reasoning? Could they even (...) have rights and a moral status? I will tentatively defend the (increasingly widely held) view that, under certain conditions, artificial intelligent systems, like corporate entities, might qualify as responsible moral agents and as holders of limited rights and legal personhood. I will further suggest that regulators should permit the use of autonomous artificial systems in high-stakes settings only if they are engineered to function as moral (not just intentional) agents and/or there is some liability-transfer arrangement in place. I will finally raise the possibility that if artificial systems ever became phenomenally conscious, there might be a case for extending a stronger moral status to them, but argue that, as of now, this remains very hypothetical. (shrink)

Which artificial intelligence (AI) systems are agents? To answer this question, I propose a multidimensional account of agency. According to this account, a system's agency profile is jointly determined by its level of goal-directedness and autonomy as well as is abilities for directly impacting the surrounding world, long-term planning and acting for reasons. Rooted in extant theories of agency, this account enables fine-grained, nuanced comparative characterizations of artificial agency. I show that this account has multiple important virtues and (...) is more informative than alternatives. More speculatively, it may help to illuminate two important emerging questions in AI ethics: 1. Can agency contribute to the moral status of non-human beings, and how? 2. When and why might AI systems exhibit power-seeking behaviour and does this pose an existential risk to humanity? (shrink)

Artificial agents, particularly but not only those in the infosphere Floridi (Information – A very short introduction. Oxford University Press, Oxford, 2010a), extend the class of entities that can be involved in moral situations, for they can be correctly interpreted as entities that can perform actions with good or evil impact (moral agents). In this chapter, I clarify the concepts of agent and of artificial agent and then distinguish between issues concerning their moral behaviour vs. (...) issues concerning their responsibility. The conclusion is that there is substantial and important scope, particularly in information ethics, for the concept of moral artificial agents not necessarily exhibiting free will, mental states or responsibility. This complements the more traditional approach, which considers whether artificial agents may have mental states, feelings, emotions and so forth. By focussing directly on “mind-less morality”, one is able to by-pass such question as well as other difficulties arising in Artificial Intelligence, in order to tackle some vital issues in contexts where artificial agents are increasingly part of the everyday environment (Floridi L, Metaphilos 39(4/5): 651–655, 2008a). (shrink)

Artificial Life has two goals. One attempts to describe fundamental qualities of living systems through agent based computer models. And the second studies whether or not we can artificially create living things in computational mediums that can be realized either, virtually in software, or through biotechnology. The study of ALife has recently branched into two further subdivisions, one is “dry” ALife, which is the study of living systems “in silico” through the use of computer simulations, and the other is (...) “wet” ALife that uses biological material to realize what has only been simulated on computers, effectively wet ALife uses biological material as a kind of computer. This is challenging to the field of computer ethics as it points towards a future in which computer and bioethics might have shared concerns. The emerging studies into wet ALife are likely to provide strong empirical evidence for ALife’s most challenging hypothesis: that life is a certain set of computable functions that can be duplicated in any medium. I believe this will propel ALife into the midst of the mother of all cultural battles that has been gathering around the emergence of biotechnology. Philosophers need to pay close attention to this debate and can serve a vital role in clarifying and resolving the dispute. But even if ALife is merely a computer modeling technique that sheds light on living systems, it still has a number of significant ethical implications such as its use in the modeling of moral and ethical systems, as well as in the creation of artificial moral agents. (shrink)

We are sometimes unsure of the moral status of our relationships with other entities. Recent case studies in this uncertainty include our relationships with artificial agents (robots, assistant AI, etc.), animals, and patients with “locked-in” syndrome. Do these entities have basic moral standing? Could they count as true friends or lovers? What should we do when we do not know the answer to these questions? An influential line of reasoning suggests that, in such cases of (...) class='Hi'>moral uncertainty, we need meta-moral decision rules that allow us to either minimize the risks of moral wrongdoing or improve the choice-worthiness of our actions. One particular argument adopted in this literature is the “risk asymmetry argument,” which claims that the risks associated with accepting or rejecting some moral facts may be sufficiently asymmetrical as to warrant favoring a particular practical resolution of this uncertainty. Focusing on the case study of artificial beings, this article argues that this is best understood as an ethical-epistemic challenge. The article argues that taking potential risk asymmetries seriously can help resolve disputes about the status of human–AI relationships, at least in practical terms (philosophical debates will, no doubt, continue); however, the resolution depends on a proper, empirically grounded assessment of the risks involved. Being skeptical about basic moral status, but more open to the possibility of meaningful relationships with such entities, may be the most sensible approach to take. (shrink)

Recently, I argued that human subjects in artificial wombs (AWs) “share the same moral status as newborns” and so, deserve the same treatment and protections as newborns. This thesis rests on two claims: (A) “Subjects of partial ectogenesis—those that develop in utero for at time before being transferred to AWs—are newborns,” and (B) “Subjects of complete ectogenesis—those who develop in AWs entirely—share the same moral status as newborns.” In response, Elizabeth Chloe Romanis argued that the (...) subject in an AW is “a unique human entity…rather than a fetus or a newborn.” She provides four lines of response to my essay. First, she argues that I have “misconstrued” what birth is. Once we correct that error, it becomes clear that subjects of partial ectogenesis have not been born. Second, she argues that my claims imply that non-implanted embryos (existing in vivo) “would also be ‘born.’” But that is absurd. Third, she claims I fail to “meaningfully respond” to distinctions she draws between subjects of ectogenesis and neonates. Finally, she criticizes my essay for focusing on subjects of AWs rather than focusing on pregnant persons (who should be at the “centre” of debates over AWs). I respond to each of these charges. In doing so, I reaffirm that (contra Romanis) some subjects of ectogenesis are newborns and all subjects of ectogenesis—even those that have not been born—share the same moral status as newborns. (shrink)