Several proposals for moral enhancement would use AI to augment (auxiliary enhancement) or even supplant (exhaustive enhancement) human moral reasoning or judgment. Exhaustive enhancement proposals conceive AI as some self-contained oracle whose superiority to our own moral abilities is manifest in its ability to reliably deliver the ‘right’ answers to all our moral problems. We think this is a mistaken way to frame the project, as it presumes that we already know many (...) things that we are still in the process of working out, and reflecting on this fact reveals challenges even for auxiliary proposals that eschew the oracular approach. We argue there is nonetheless a substantial role that ‘AI mentors’ could play in our moral education and training. Expanding on the idea of an AI Socratic Interlocutor, we propose a modular system of multiple AI interlocutors with their own distinct points of view reflecting their training in a diversity of concrete wisdom traditions. This approach minimizes any risk of moral disengagement, while the existence of multiple modules from a diversity of traditions ensures pluralism is preserved. We conclude with reflections on how all this relates to the broader notion of moral transcendence implicated in the project of AI moral enhancement, contending it is precisely the whole concrete socio-technical system of moral engagement that we need to model if we are to pursue moral enhancement. (shrink)

도덕적 향상은 인간의 영원한 과제이다. 그런 만큼 최근에 과학적 방법에 의해 도덕적 향상의 방안이 모색되고 있는 것은 매우 고무적이다. 인간의 도덕성을 과학적으로 향상하려는 방안에는 생의학과 인공지능에 의한 두 가지 방법이 있다. 이 중에서 생의학에 의한 ‘도덕적 생명 향상’ 방안이 먼저 시도되었지만, 생의학에 의한 생명 향상은 인간의 심성에 인위적, 강제적으로 개입한다는 한계가 있다. 인위적 개입이 아무리 선한 의도에서 출발했더라도, 강제는 절차상으로 개인의 자율성과 정체성 확립을 위협하는 심각한 부작용을 초래한다. 이에 ‘인공지능’이 새로운 대안으로 부상했다. 이것이 ‘도덕적 인공지능 향상’이다.BR 방법적으로 생의학이 인간의 심성에 (...) 작용하는 것과 달리, 인공지능은 인간의 지적 판단(력)에 작용한다. 먼저 우리는 인공지능에 의한 도덕적 제어가 어떻게 가능한지 살펴볼 것이다(2장). 여기에도 분명 한계와 단점은 있다. 그러나 우리는 이러한 한계와 단점을 극복하고 인공지능이 우리의 도덕적 향상을 위해 기여할 수 있는 방안을 적극 모색할 것이다(3장). 그리고 인간의 영원한 과제인 도덕적 향상을 위해서는 인공지능 알고리즘의 (맞춤형) 설계가 필요해 보인다(4장). 이것은 어떤 의미에서 ‘새로운 종합’이다. 이 종합에서 해악의 창발적 생성에 능동적으로 대처할 수만 있다면, 이로써 새로운 도덕성 형성의 토대를 마련할 수 있는 길도 열릴 것으로 우리는 기대한다. (shrink)

The moral enhancement of human beings is a constant theme in the history of humanity. Today, faced with the threats of a new, globalised world, concern over this matter is more pressing. For this reason, the use of biotechnology to make human beings more moral has been considered. However, this approach is dangerous and very controversial. The purpose of this article is to argue that the use of another new technology, AI, would be preferable to achieve this (...) goal. Whilst several proposals have been made on how to use AI for moral enhancement, we present an alternative that we argue to be superior to other proposals that have been developed. (shrink)

Moral enhancement proposals struggle to be both plausible and ethically defensible while nevertheless interestingly distinct from both cognitive enhancement as well as (mere) moral education. Brian Earp (_Royal Institute of Philosophy Supplement_ 83:415–439, 12 ) suggests that a promising middle ground lies in focusing on the (suitably qualified) use of psychedelics as _adjuncts_ to moral development. But what would such an adjunctive use of psychedelics look like in practice? In this paper, I draw on literature (...) from three areas where techniques for moral development have been discussed: psychotherapy (e.g., Overholser 2010; Burns 1980) education (e.g., Uhl and Lütge, 2018), and AI-assisted enhancement (e.g., Lara and Deckers, _Neuroethics_ 13(3):275–287, 17 ) in order to propose more concrete ways in which to use psychedelics as adjuncts to moral development. It is shown that in each of these areas, we can see that _trusting_ relationships (e.g., Baier 1986; Hawley 2019) between the facilitator and the agent will very plausibly maximize the success of this type of moral enhancement. Finally, I appeal to literature on informed consent for use of psychedelics (e.g., Smith and Sisti, _Journal of Medical Ethics_, 22 ; Johnson et al., _The Journal of Psychopharmacology_ 22(6):603–20, 23 ) and on the therapeutic relationship in psychotherapy (e.g., Dryden and Reeves 2013; Horvath et al. 2011) to outline concrete suggestions for facilitating dimensions of trust most likely to maximize the benefits of (adjunctive) psychedelic moral enhancement. The result is a newly detailed practical proposal for how we might best facilitate moral enhancement by using drugs as adjuncts to moral development. (shrink)

We are moving towards a future where Artificial Intelligence (AI) based agents make many decisions on behalf of humans. From healthcare decision-making to social media censoring, these agents face problems, and make decisions with ethical and societal implications. Ethical behaviour is a critical characteristic that we would like in a human-centric AI. A common observation in human-centric industries, like the service industry and healthcare, is that their professionals tend to break rules, if necessary, for pro-social reasons. This behaviour among humans (...) is defined as pro-social rule breaking. To make AI agents more human-centric, we argue that there is a need for a mechanism that helps AI agents identify when to break rules set by their designers. To understand when AI agents need to break rules, we examine the conditions under which humans break rules for pro-social reasons. In this paper, we present a study that introduces a ‘vaccination strategy dilemma’ to human participants and analyzes their response. In this dilemma, one needs to decide whether they would distribute COVID-19 vaccines only to members of a high-risk group (follow the enforced rule) or, in selected cases, administer the vaccine to a few social influencers (break the rule), which might yield an overall greater benefit to society. The results of the empirical study suggest a relationship between stakeholder utilities and pro-social rule breaking (PSRB), which neither deontological nor utilitarian ethics completely explain. Finally, the paper discusses the design characteristics of an ethical agent capable of PSRB and the future research directions on PSRB in the AI realm. We hope that this will inform the design of future AI agents, and their decision-making behaviour. (shrink)

Can Artificial Intelligence be more effective than human instruction for the moral enhancement of people? The author argues that it only would be if the use of this technology were aimed at increasing the individual's capacity to reflectively decide for themselves, rather than at directly influencing behaviour. To support this, it is shown how a disregard for personal autonomy, in particular, invalidates the main proposals for applying new technologies, both biomedical and AI-based, to moral enhancement. As (...) an alternative to these proposals, this article proposes a virtual assistant that, through dialogue, neutrality and virtual reality technologies, can teach users to make better moral decisions on their own. The author concludes that, as long as certain precautions are taken in its design, such an assistant could do this better than a human instructor adopting the same educational methodology. (shrink)

:Any space program involving long-term human missions will have to cope with serious risks to human health and life. Because currently available countermeasures are insufficient in the long term, there is a need for new, more radical solutions. One possibility is a program of human enhancement for future deep space mission astronauts. This paper discusses the challenges for long-term human missions of a space environment, opening the possibility of serious consideration of human enhancement and a fully automated space (...) exploration, based on highly advanced AI. The author argues that for such projects, there are strong reasons to consider human enhancement, including gene editing of germ line and somatic cells, as a moral duty. (shrink)

Deep learning AI systems have proven a wide capacity to take over human-related activities such as car driving, medical diagnosing, or elderly care, often displaying behaviour with unpredictable consequences, including negative ones. This has raised the question whether highly autonomous AI may qualify as morally responsible agents. In this article, we develop a set of four conditions that an entity needs to meet in order to be ascribed moral responsibility, by drawing on Aristotelian ethics and contemporary philosophical research. We (...) encode these conditions and generate a flowchart that we call the Moral Responsibility Test. This test can be used as a tool both to evaluate whether an entity is a morally responsible agent and to inform human moral decision-making over the influencing variables of the context of action. We apply the test to the case of Artificial Moral Advisors and conclude that this form of AI cannot qualify as morally responsible agents. We further discuss the implications for the use of AMAs as moral enhancement and show that using AMAs to offload human responsibility is inadequate. We argue instead that AMAs could morally enhance users if they are interpreted as enablers for moral knowledge of the contextual variables surrounding human moral decision-making, with the implication that such a use might actually enlarge human moral responsibility. (shrink)

Human beings are internally inconsistent in various ways. One way to develop this thought involves using the language of value alignment: the values we hold are not always aligned with our behavior, and are not always aligned with each other. Because of this self-misalignment, there is room for potential projects of human enhancement that involve achieving a greater degree of value alignment than we presently have. Relatedly, discussions of AI ethics sometimes focus on what is known as the value (...) alignment problem, the challenge of how to build AI that acts in accordance with our human values. We argue that there is an especially close connection between solving the value alignment problem in AI ethics and using AI to pursue certain forms of human enhancement. But in addition, we also argue that there are important limits to what kinds of human enhancement can be pursued in this way, because some forms of human enhancement—namely moral revolutions—involve a kind of value misalignment rather than alignment. (shrink)

The prevailing discourse around AI ethics lacks the language and formalism necessary to capture the diverse ethical concerns that emerge when AI systems interact with individuals. Drawing on Sen and Nussbaum's capability approach, we present a framework formalizing a network of ethical concepts and entitlements necessary for AI systems to confer meaningful benefit or assistance to stakeholders. Such systems enhance stakeholders' ability to advance their life plans and well-being while upholding their fundamental rights. We characterize two necessary conditions for morally (...) permissible interactions between AI systems and those impacted by their functioning, and two sufficient conditions for realizing the ideal of meaningful benefit. We then contrast this ideal with several salient failure modes, namely, forms of social interactions that constitute unjustified paternalism, coercion, deception, exploitation and domination. The proliferation of incidents involving AI in high-stakes domains underscores the gravity of these issues and the imperative to take an ethics-led approach to AI systems from their inception. (shrink)

The revolution of artificial intelligence (AI), particularly generative AI, and its implications for human–robot interaction (HRI) opened up the debate on crucial regulatory, business, societal, and ethical considerations. This paper explores essential issues from the anthropomorphic perspective, examining the complex interplay between humans and AI models in societal and corporate contexts. We provided a comprehensive review of existing literature on HRI, with a special emphasis on the impact of generative models such as ChatGPT. The scientometric study posits that due to (...) their advanced linguistic capabilities and ability to mimic human-like behavior, generative AIs like ChatGPT will continue to grow in popularity in pair with human rational empathy, tendency for personification and their advanced linguistic capabilities and ability to mimic human-like behavior. As they blur the boundaries between humans and robots, these models introduce fresh moral and philosophical dilemmas. Our research aims to extrapolate key trends and unique factors in HRI and to elucidate the technical aspects of generative AI that enhance its effectiveness in this field compared to traditional rule-based AI systems. We further discuss the challenges and limitations of applying generative AI in HRI, providing a future research agenda for AI optimization in diverse applications, including education, entertainment, and healthcare. (shrink)

With Artificial Intelligence entering our lives in novel ways—both known and unknown to us—there is both the enhancement of existing ethical issues associated with AI as well as the rise of new ethical issues. There is much focus on opening up the ‘black box’ of modern machine-learning algorithms to understand the reasoning behind their decisions—especially morally salient decisions. However, some applications of AI which are no doubt beneficial to society rely upon these black boxes. Rather than requiring algorithms to (...) be transparent we should focus on constraining AI and those machines powered by AI within microenvironments—both physical and virtual—which allow these machines to realize their function whilst preventing harm to humans. In the field of robotics this is called ‘envelopment’. However, to put an ‘envelope’ around AI-powered machines we need to know some basic things about them which we are often in the dark about. The properties we need to know are the: training data, inputs, functions, outputs, and boundaries. This knowledge is a necessary first step towards the envelopment of AI-powered machines. It is only with this knowledge that we can responsibly regulate, use, and live in a world populated by these machines. (shrink)

¿Puede la inteligencia artificial (IA) hacernos más morales o ayudarnos a tomar decisiones más éticas? El libro Más (que) humanos. Biotecnología, inteligencia artificial y ética de la mejora, editado por Francisco Lara y Julian Savulescu (2021), puede inspirarnos filosóficamente sobre este debate contemporáneo. En esta nota crítica, contextualizo la aportación general del volumen y analizo los dos últimos capítulos de Monasterio-Astobiza y de Lara y Deckers, quienes argumentan a favor del uso de la IA para hacernos mejores agentes morales. El (...) objetivo es ampliar y matizar críticamente algunas cuestiones clave sobre cómo la IA puede asistirnos para tomar decisiones más éticas. (shrink)

Our rapidly increasing reliance on frictionless AI interactions may increase cognitive and emotional distance, thereby letting our adaptive resilience slacken and our ethical virtues atrophy from disuse. Many trends already well underway involve the offloading of cognitive, emotional, and ethical labor to AI software in myriad social, civil, personal, and professional contexts. Gradually, we may lose the inclination and capacity to engage in critically reflective thought, making us more cognitively and emotionally vulnerable and thus more anxious and prone to manipulation (...) from false news, deceptive advertising, and political rhetoric. In this article, I consider the overarching features of this problem and provide a framework to help AI designers tackle it through system enhancements in smartphones and other products and services in the burgeoning internet of things (IoT) marketplace. The framework is informed by two ideas: psychologist Daniel Kahneman’s cognitive dual process theory and moral self-awareness theory, a four-level model of moral identity that I developed with Benjamin M. Cole. (shrink)

The history of humankind is full of examples that indicate a constant desire to make human beings more moral. Nowadays, technological breakthroughs might have a significant impact on our moral character and abilities. This is the case of Virtual Reality (VR) technologies. The aim of this paper is to consider the ethical aspects of the use of VR in enhancing empathy. First, we will offer an introduction to VR, explaining its fundamental features, devices and concepts. Then, we will (...) approach the characterization of VR as an “empathy machine,” showing why this medium has aroused so much interest and why, nevertheless, we do not believe it is the ideal way to enhance empathy. As an alternative, we will consider fostering empathy-related abilities through virtual embodiment in avatars. In the conclusion, however, we will, we will examine some of the serious concerns related to the ethical relevance of empathy and will defend the philosophical case for a reason-guided empathy, also suggesting specific guidelines for possible future developments of empathy enhancement projects through VR embodied experiences. (shrink)

Artificial intelligence (AI), blockchain, virtual and augmented reality, (semi-)autonomous ve- hicles, autoregulatory weapon systems, enhancement, reproductive technologies and human- oid robotics – these technologies (and many others) are no longer speculative visions of the future; they have already found their way into our lives or are on the verge of a breakthrough. These rapid technological developments awaken a need for orientation: what distinguishes hu- man from machine and human intelligence from artificial intelligence, how far should the body be allowed (...) to be changed and what are the dangers and opportunities presented by these technologies? Many of these questions are also addressed to theology. For example, questions about the image of humanity, the understanding of creation, the ethics of technological body interventions or the moral status of robots. What does theology have to say about these technological developments? It is the right time for theology to scientifically explore tech- nologization and AI and to formulate answers. As technology changes the various areas of human life, society and the world around us, the places and topics of theology are also undergoing transformation. Puzio, Anna: Theology Meets AI: Examining Perspectives, Tasks, and Theses on the Intersection of Technology and Religion. In: Puzio, Anna/Kunkel, Nicole/Klinge, Hendrik (Hg.): Alexa, How Do You Feel About Religion? Theological Approaches to Technology and Artificial Intelligence (Theology and AI 1). Darmstadt: wbg 2023, S. 29–41. DOI: 10.53186/1030373. (shrink)

Purpose Artificial intelligence (AI) has sparked interest in various areas, including marketing. However, this exhilaration is being tempered by growing concerns about the moral and legal implications of using AI in marketing. Although previous research has revealed various ethical and legal issues, such as algorithmic discrimination and data privacy, there are no definitive answers. This paper aims to fill this gap by investigating AI’s ethical and legal concerns in marketing and suggesting feasible solutions. Design/methodology/approach The paper synthesises information from (...) academic articles, industry reports, case studies and legal documents through a thematic literature review. A qualitative analysis approach categorises and interprets ethical and legal challenges and proposes potential solutions. Findings The findings of this paper raise concerns about ethical and legal challenges related to AI in the marketing area. Ethical concerns related to discrimination, bias, manipulation, job displacement, absence of social interaction, cybersecurity, unintended consequences, environmental impact, privacy and legal issues such as consumer security, responsibility, liability, brand protection, competition law, agreements, data protection, consumer protection and intellectual property rights are discussed in the paper, and their potential solutions are discussed. Research limitations/implications Notwithstanding the interesting insights gathered from this investigation of the ethical and legal consequences of AI in marketing, it is important to recognise the limits of this research. Initially, the focus of this study is confined to a review of the most important ethical and legal issues pertaining to AI in marketing. Additional possible repercussions, such as those associated with intellectual property, contracts and licencing, should be investigated more deeply in future studies. Despite the fact that this study gives various answers and best practices for tackling the stated ethical and legal concerns, the viability and efficacy of these solutions may differ depending on the context and industry. Thus, more research and case studies are required to evaluate the applicability and efficacy of these solutions in other circumstances. This research is mostly based on a literature review and may not represent the experiences or opinions of all stakeholders engaged in AI-powered marketing. Further study might involve interviews or surveys with marketing professionals, customers and other key stakeholders to offer a full knowledge of the practical difficulties and solutions. Because of the rapid speed of technical progress, AI’s ethical and regulatory ramifications in marketing are continually increasing. Consequently, this work should be a springboard for more research and continuing conversations on this subject. Practical implications This study’s findings have several practical implications for marketing professionals. Emphasising openness and explainability: Marketing professionals should prioritise transparency in their use of AI, ensuring that customers are fully informed about data collection and utilisation for targeted advertising. By promoting openness and explainability, marketers can foster customer trust and avoid the negative consequences of a lack of transparency. Establishing ethical guidelines: Marketing professionals need to develop ethical rules for the creation and implementation of AI-powered marketing strategies. Adhering to ethical principles ensures compliance with legal norms and aligns with the organisation’s values and ideals. Investing in bias detection tools and privacy-enhancing technology: To mitigate risks associated with AI in marketing, marketers should allocate resources to develop and implement bias detection tools and privacy-enhancing technology. These tools can identify and address biases in AI algorithms, safeguard consumer privacy and extract valuable insights from consumer data. Social implications This study’s social implications emphasise the need for a comprehensive approach to address the ethical and legal challenges of AI in marketing. This includes adopting a responsible innovation framework, promoting ethical leadership, using ethical decision-making frameworks and conducting multidisciplinary research. By incorporating these approaches, marketers can navigate the complexities of AI in marketing responsibly, foster an ethical organisational culture, make informed ethical decisions and develop effective solutions. Such practices promote public trust, ensure equitable distribution of benefits and risk, and mitigate potential negative social consequences associated with AI in marketing. Originality/value To the best of the authors’ knowledge, this paper is among the first to explore potential solutions comprehensively. This paper provides a nuanced understanding of the challenges by using a multidisciplinary framework and synthesising various sources. It contributes valuable insights for academia and industry. (shrink)

Autonomy has been central to moral and political philosophy for millenia, and has been positioned as a critical aspect of both justice and wellbeing. Research in psychology supports this position, providing empirical evidence that autonomy is critical to motivation, personal growth and psychological wellness. Responsible AI will require an understanding of, and ability to effectively design for, human autonomy (rather than just machine autonomy) if it is to genuinely benefit humanity. Yet the effects on human autonomy of digital experiences (...) are neither straightforward nor consistent, and are complicated by commercial interests and tensions around compulsive overuse. This multi-layered reality requires an analysis that is itself multidimensional and that takes into account human experience at various levels of resolution. We borrow from HCI and psychological research to apply a model (“METUX”) that identifies six distinct spheres of technology experience. We demonstrate the value of the model for understanding human autonomy in a technology ethics context at multiple levels by applying it to the real-world case study of an AI-enhanced video recommender system. In the process we argue for the following three claims: 1) There are autonomy-related consequences to algorithms representing the interests of third parties, and they are not impartial and rational extensions of the self, as is often perceived; 2) Designing for autonomy is an ethical imperative critical to the future design of responsible AI; and 3) Autonomy-support must be analysed from at least six spheres of experience in order to approriately capture contradictory and downstream effects. (shrink)

Many of our daily activities are now made more convenient and efficient by virtual assistants, and the day when they can be designed to instruct us in certain skills, such as those needed to make moral judgements, is not far off. In this paper we ask to what extent it would be ethically acceptable for these so-called virtual assistants for moral enhancement to use subtle strategies, known as “nudges”, to influence our decisions. To achieve our goal, we (...) will first characterise nudges in their standard use and discuss the debate they have generated around their possible manipulative character, establishing three conditions of manipulation. Secondly, we ask whether nudges can occur in moral virtual assistants that are not manipulative. After critically analysing some proposed virtual assistants, we argue in favour of one of them, given that by pursuing an open and neutral moral enhancement, it promotes and respects the autonomy of the person as much as possible. Thirdly, we analyse how nudges could enhance the functioning of such an assistant, and evaluate them in terms of their degree of threat to the subject’s autonomy and their level of transparency. Finally, we consider the possibility of using motivational nudges, which not only help us in the formation of moral judgements but also in our moral behaviour. (shrink)

Humans have invented intelligent machinery to enhance their rational decision-making procedure, which is why it has been named ‘augmented intelligence’. The usage of artificial intelligence (AI) technology is increasing enormously with every passing year, and it is becoming a part of our daily life. We are using this technology not only as a tool to enhance our rationality but also heightening them as the autonomous ethical agent for our future society. Norbert Wiener envisaged ‘Cybernetics’ with a view of a brain-machine (...) interface to augment human beings' biological rationality. Being an autonomous ethical agent presupposes an ‘agency’ in moral decision-making procedure. According to agency's contemporary theories, AI robots might be entitled to some minimal rational agency. However, that minimal agency might not be adequate for a fully autonomous ethical agent's performance in the future. If we plan to implement them as an ethical agent for the future society, it will be difficult for us to judge their actual stand as a moral agent. It is well known that any kind of moral agency presupposes consciousness and mental representations, which cannot be articulated synthetically until today. We can only anticipate that this milestone will be achieved by AI scientists shortly, which will further help them triumph over ‘the problem of ethical agency in AI’. Philosophers are currently trying a probe of the pre-existing ethical theories to build a guidance framework for the AI robots and construct a tangible overview of artificial moral agency. Although, no unanimous solution is available yet. It will land up in another conflicting situation between biological, moral agency and autonomous ethical agency, which will leave us in a baffled state. Creating rational and ethical AI machines will be a fundamental future research problem for the AI field. This paper aims to investigate ‘the problem of moral agency in AI’ from a philosophical outset and hold a survey of the relevant philosophical discussions to find a resolution for the same. (shrink)

In this article, I use science-fiction scenarios drawn from Dan Simmons’ “Hyperion Cantos” (Hyperion, The Fall of Hyperion, Endymion, The Rise of Endymion) to explore a cluster of issues related to the evolutionary history and neural bases of human moral cognition, and the moral desirability of improving our ability to make moral decisions by techniques of neuroengineering. I begin by sketching a picture of what recent research can teach us about the character of human moral psychology, (...) with a particular emphasis on highlighting the importance of our evolutionary background as social mammals. I then consider how the moral psychology of intelligent machines might differ from our own, and argue that the differences would depend on the extent to which their evolutionary background resembled our own. I offer two very different case studies—the “Technocore AIs” that have evolved from early, parasitic computer programs, and the mysterious “Shrike,” who travels backward through time. I close by looking at the character of Aenea, a messianic figure that is a joint descendant of humans and machines. I argue that while the sort of “moral enhancement” she represents is far beyond the scope of either contemporary neuroscience or artificial intelligence research, it nevertheless represents a worthwhile goal. (shrink)

This paper discusses the establishment of a governance framework to secure the development and deployment of “good AI”, and describes the quest for a morally objective compass to steer it. Asserting that human rights can provide such compass, this paper first examines what a human rights-based approach to AI governance entails, and sets out the promise it propagates. Subsequently, it examines the pitfalls associated with human rights, particularly focusing on the criticism that these rights may be too Western, too individualistic, (...) too narrow in scope and too abstract to form the basis of sound AI governance. After rebutting these reproaches, a plea is made to move beyond the calls for a human rights-based approach, and start taking the necessary steps to attain its realisation. It is argued that, without elucidating the applicability and enforceability of human rights in the context of AI; adopting legal rules that concretise those rights where appropriate; enhancing existing enforcement mechanisms and securing an underlying societal infrastructure that enables human rights in the first place, any human rights-based governance framework for AI risks falling short of its purpose. (shrink)

Among the many applications of artificial intelligence (AI), virtual assistants are one of the tools most likely to grow in the future. The development of these systems may play an increasingly important role in many facets of our lives. Therefore, given their potential importance and present and future weight, it is worthwhile to analyze what kind of challenges they entail. In this chapter, we will provide an overview of the ethical aspects of artificial virtual assistants. First, we provide a conceptual (...) clarification of the term ‘virtual assistant’, including different types of interfaces and recommender systems. Second, we address three ethical issues related to the deployment of these systems: their effects on human agency and autonomy and the subsequent cognitive dependence they would generate; the human obsolescence that may cause a generalized extension of the dependence problem; and the invasions of privacy that virtual assistants may cause. Finally, we outline the debates about the use of virtual assistants to improve human moral decisions and some areas in which these systems can be applied. (shrink)

Biomedical moral enhancement, or BME for short, aims to improve people’s moral behaviors through augmenting, via biomedical means, their virtuous dispositions such as sympathy, honesty, courage, or generosity. Recently, it has been challenged, on particularist grounds, however, that the manifestations of the virtuous dispositions can be morally wrong. For instance, being generous in terrorist financing is one such case. If so, biomedical moral enhancement, by enhancing people’s virtues, might turn out to be counterproductive in terms (...) of people’s moral behaviors. In this paper, we argue, via a comparison with moral education, that the case for the practice of biomedical moral enhancement is not weakened by the particularists’ stress on the variable moral statuses of the manifestations of our virtues. The real challenge from the particularists, we argue, lies elsewhere. It is that practical wisdom, being essentially context-sensitive, cannot be enhanced via biomedical means. On the basis of this, we further argue that BME ought to be used with great caution, for it may wrongly enhance, for instance, a terrorist financier’s generosity, a robber’s courage, or an undercover detective’s honesty. Finally, we sketch how boundaries can be set on the use of BME, and address some potential objections to our position. (shrink)

Michael Walzer’s article ‘Political action: the problem of dirty hands’ initiated a new wave of discussion over a persistent problem in moral philosophy: are there situations in which ethical rules must be relaxed so as to bring about a greater good? In this article, we consider whether this ‘dirty hands’ approach may be applied to our current climate crisis. One proposed solution to the problem of global warming is the administration of moral enhancements to the population. Assuming that (...) the administration of moral enhancements is a necessary condition in the prevention of a climate crisis, Parker Crutchfield argues that this procedure ought to be covert. This implies lying to the public, and such dishonesty amounts to immoral behavior. We conclude that despite the severity of global warming, there is no justification for a dirty hands approach. Lying to the public in order to save the planet would probably create bigger problems, and it would ultimately be very counterproductive in trying to save the planet. (shrink)

Artificial intelligence is becoming increasingly entwined with our daily lives: AIs work as assistants through our phones, control our vehicles, and navigate our vacuums. As these objects become more complex and work within our societies in ways that affect our well-being, there is a growing demand for machine ethics—we want a guarantee that the various automata in our lives will behave in a way that minimizes the amount of harm they create. Though many technologies exist as moral artifacts, the (...) development of a truly ethical AI system is highly contentious; theorists have proposed and critiqued countless possibilities for programming these agents to become ethical. Many of these arguments, however, presuppose the possibility that an artificially intelligent system can actually be ethical. In this essay, I will explore a potential path to AI ethics by considering the role of imagination in the deliberative process via the work of John Dewey and his interpreters, showcasing one form of reinforcement learning that mimics imaginative deliberation. With these components in place, I contend that such an artificial agent is capable of something very near ethical behavior—close enough that we may consider it so. (shrink)

This paper identifies human enhancement as one of the most significant areas of bioethical interest in the last twenty years. It discusses in more detail one area, namely moral enhancement, which is generating significant contemporary interest. The author argues that so far from being susceptible to new forms of high tech manipulation, either genetic, chemical, surgical or neurological, the only reliable methods of moral enhancement, either now or for the foreseeable future, are either those that (...) have been in human and animal use for millennia, namely socialization, education and parental supervision or those high tech methods that are general in their application. By that is meant those forms of cognitive enhancement that operate across a wide range of cognitive abilities and do not target specifically ‘ethical’ capacities. The paper analyses the work of some of the leading contemporary advocates of moral enhancement and finds that in so far as they identify moral qualities or moral emotions for enhancement they have little prospect of success. (shrink)

We respond to a number of objections raised by John Harris in this journal to our argument that we should pursue genetic and other biological means of morally enhancing human beings (moral bioenhancement). We claim that human beings now have at their disposal means of wiping out life on Earth and that traditional methods of moral education are probably insufficient to achieve the moral enhancement required to ensure that this will not happen. Hence, we argue, (...) class='Hi'>moral bioenhancement should be sought and applied. We argue that cognitive enhancement and technological progress raise acute problems because it is easier to harm than to benefit. We address objections to this argument. We also respond to objections that moral bioenhancement: (1) interferes with freedom; (2) cannot be made to target immoral dispositions precisely; (3) is redundant, since cognitive enhancement by itself suffices. (shrink)

A significant stimulus for co-editing a book on AI ethics comes from a collaboration between Francisco Lara and Jan Deckers that started when Francisco spent some time, in 2017, as a visiting researcher in the School of Medicine at Newcastle University (United Kingdom). Both of us had been interested for quite some time in the ethics of human enhancement by biotechnological means. Both saw significant problems with these ambitions and associated technologies, recognising at the same time the value of, (...) and the need for a particular type of human enhancement, the improvement of our moral skills. This collaboration resulted in the idea that artificial intelligence (AI) might potentially fulfil a useful role in this respect, and led to the publication of an article that makes a case for designing and using ‘Artificial Intelligence as a Socratic Assistant for Moral Enhancement’ (Lara and Deckers 2020). Francisco subsequently developed this idea, arguing that such a virtual assistant might be even better than a human being in morally enhancing AI users (Lara 2021), whilst Jan spent some time thinking through the nature of the unnatural or artificial (Deckers 2021). Meanwhile, both of us developed a greater awareness of the moral problems and opportunities of AI in general, and of the urgent need to explore, resolve, and govern the ethical issues raised by AI. (shrink)

Some argue that humans should enhance their moral capacities by adopting institutions that facilitate morally good motives and behaviour. I have defended a parallel claim: that we could permissibly use biomedical technologies to enhance our moral capacities, for example by attenuating certain counter-moral emotions. John Harris has recently responded to my argument by raising three concerns about the direct modulation of emotions as a means to moral enhancement. He argues that such means will be relatively (...) ineffective in bringing about moral improvements, that direct modulation of emotions would invariably come at an unacceptable cost to our freedom, and that we might end up modulating emotions in ways that actually lead to moral decline. In this article I outline some counter-intuitive potential implications of Harris' claims. I then respond individually to his three concerns, arguing that they license only the very weak conclusion that moral enhancement via direct emotion modulation is sometimes impermissible. However I acknowledge that his third concern might, with further argument, be developed into a more troubling objection to such enhancements. (shrink)

One of the reasons why moral enhancement may be controversial, is because the advantages of moral enhancement may fall upon society rather than on those who are enhanced. If directed at individuals with certain counter-moral traits it may have direct societal benefits by lowering immoral behavior and increasing public safety, but it is not directly clear if this also benefits the individual in question. In this paper, we will discuss what we consider to be (...) class='Hi'>moral enhancement, how different means may be used to achieve it and whether the means we employ to reach moral enhancement matter morally. Are certain means to achieve moral enhancement wrong in themselves? Are certain means to achieve moral enhancement better than others, and if so, why? More specifically, we will investigate whether the difference between direct and indirect moral enhancement matters morally. Is it the case that indirect means are morally preferable to direct means of moral enhancement and can we indeed pinpoint relevant intrinsic, moral differences between both? We argue that the distinction between direct and indirect means is indeed morally relevant, but only insofar as it tracks an underlying distinction between active and passive interventions. Although passive interventions can be ethical provided specific safeguards are put in place, these interventions exhibit a greater potential to compromise autonomy and disrupt identity. (shrink)

A new argument has been made against moral enhancement by authors who are otherwise in favour of human enhancement. Additionally, they share the same evolutionary toolkit for analysing human traits as well as the belief that our current morality is unfit to deal with modern problems, such as climate change and nuclear proliferation. The argument is put forward by Buchanan and Powell and states that other paths to moral progress are enough to deal with these problems. (...) Given the likely costs and risks involved with developing moral enhancement, this argument implies moral enhancement is an unpromising enterprise. After mentioning proposed solutions to such modern problems, I will argue that moral enhancement would help implement any of them. I will then detail Buchanan and Powell’s new argument disfavouring moral enhancement and argue that it makes too bold assumptions about the efficacy of traditional moral progress. For instance, it overlooks how that progress was to achieve even in relatively successful cases such as the abolition of slavery. Traditional moral progress is likely to require assistance from non-traditional means in order to face new challenges. (shrink)

While philosophers are often concerned with the conditions for moral knowledge or justification, in practice something arguably less demanding is just as, if not more, important – reliably making correct moral judgments. Judges and juries should hand down fair sentences, government officials should decide on just laws, members of ethics committees should make sound recommendations, and so on. We want such agents, more often than not and as often as possible, to make the right decisions. The purpose of (...) this paper is to propose a method of enhancing the moral reliability of such agents. In particular, we advocate for a procedural approach; certain internal processes generally contribute to people’s moral reliability. Building on the early work of Rawls, we identify several particular factors related to moral reasoning that are specific enough to be the target of practical intervention: logical competence, conceptual understanding, empirical competence, openness, empathy and bias. Improving on these processes can in turn make people more morally reliable in a variety of contexts and has implications for recent debates over moral enhancement. (shrink)

With the rise and public accessibility of AI-enabled decision-support systems, individuals outsource increasingly more of their decisions, even those that carry ethical dimensions. Considering this trend, scholars have highlighted that uncritical deference to these systems would be problematic and consequently called for investigations of the impact of pertinent technology on humans’ ethical decision-making. To this end, this article conducts a systematic review of existing scholarship and derives an integrated framework that demonstrates how intelligent decision-support systems (IDSSs) shape humans’ ethical decision-making. (...) In particular, we identify resulting consequences on an individual level (i.e., deliberation enhancement, motivation enhancement, autonomy enhancement and action enhancement) and on a societal level (i.e., moral deskilling, restricted moral progress and moral responsibility gaps). We carve out two distinct methods/operation types (i.e., processoriented and outcome-oriented navigation) that decision-support systems can deploy and postulate that these determine to what extent the previously stated consequences materialize. Overall, this study holds important theoretical and practical implications by establishing clarity in the conceptions, underlying mechanisms and (directions of) influences that can be expected when using particular IDSSs for ethical decisions. (shrink)

Moral enhancement refers to the possibility of making individuals and societies better from a moral standpoint. A fierce debate has emerged about the ethical aspects of moral enhancement, notably because steering moral enhancement in a particular direction involves choosing amongst a wide array of competing options, and these options entail deciding which moral theory or attributes of the moral agent would benefit from enhancement. Furthermore, the ability and effectiveness of different (...) neurotechnologies to enhance morality have not been carefully examined. In this paper, we assess the practical feasibility of moral enhancement neurotechnologies. We reviewed the literature on neuroscience and cognitive science models of moral judgment and analyzed their implications for the specific target of intervention in moral enhancement. We also reviewed and compared evidence on available neurotechnologies that could serve as tools of moral enhancement. We conclude that the predictions of rationalist, emotivist, and dual process models are at odds with evidence, while different intuitionist models of moral judgment are more likely to be aligned with it. Furthermore, the project of moral enhancement is not feasible in the near future as it rests on the use of neurointerventions, which have no moral enhancement effects or, worse, negative effects. (shrink)

This paper explores the position that moral enhancement interventions could be medically indicated in cases where they provide a remedy for a lack of empathy, when such a deficit is considered pathological. In order to argue this claim, the question as to whether a deficit of empathy could be considered to be pathological is examined, taking into account the difficulty of defining illness and disorder generally, and especially in the case of mental health. Following this, Psychopathy and a (...) fictionalised mental disorder are explored with a view to consider moral enhancement techniques as possible treatments for both conditions. At this juncture, having asserted and defended the position that moral enhancement interventions could, under certain circumstances, be considered medically indicated, this paper then goes on to briefly explore some of the consequences of this assertion. First, it is acknowledged that this broadening of diagnostic criteria in light of new interventions could fall foul of claims of medicalisation. It is then briefly noted that considering moral enhancement technologies to be akin to therapies in certain circumstances could lead to ethical and legal consequences and questions, such as those regarding regulation, access, and even consent. (shrink)

Moral enhancement is a topic that has sparked much current interest in the world of bioethics. The possibility of making people ‘better,’ not just in the conventional enhancement sense of improving health and other desirable qualities and capacities, but by making them somehow more moral, more decent, altogether better people, has attracted attention from both advocates 1 2 and sceptics 3 alike. The concept of moral enhancement, however, is fraught with difficult questions, theoretical and (...) practical. What does it actually mean to be ‘more moral’? How would moral enhancement be defined and would it necessarily, as some have claimed, make the world a better or safer place? How would or could such enhancement be achieved safely and without undue constraint on personal liberty and autonomy? On this subject, a recent paper by Crockett et al 4 investigating the effects of the neurotransmitter serotonin on moral decision-making provides an intriguing scientific basis for examining what might or might not constitute moral enhancement. The study involved treatment with citalopram, a drug that increases the action of serotonin in the brain, and subsequent analysis of participants' decision-making behaviour in two different situations involving moral dilemmas: the well-known ‘Trolley Problem’ 5 and the ‘Ultimatum Game’. 6 The researchers found that citalopram promoted what they call ‘prosocial behaviour’, increasing the participants' aversion to causing direct harm to others: in the first scenario, they were less likely to select the option that required killing one in order to save five, and in the second, less likely to reject unfair offers at the expense of others. The Crockett study is fascinating both for its insight into human behaviour and because it appears to demonstrate that, at least on some accounts of moral behaviour, serotonin may in fact be a …. (shrink)

Opponents of biomedical enhancement often claim that, even if such enhancement would benefit the enhanced, it would harm others. But this objection looks unpersuasive when the enhancement in question is a moral enhancement — an enhancement that will expectably leave the enhanced person with morally better motives than she had previously. In this article I (1) describe one type of psychological alteration that would plausibly qualify as a moral enhancement, (2) argue that (...) we will, in the medium-term future, probably be able to induce such alterations via biomedical intervention, and (3) defend future engagement in such moral enhancements against possible objections. My aim is to present this kind of moral enhancement as a counter-example to the view that biomedical enhancement is always morally impermissible. (shrink)

A common objection to moral enhancement is that it would undermine our moral freedom and that this is a bad thing because moral freedom is a great good. Michael Hauskeller has defended this view on a couple of occasions using an arresting thought experiment called the 'Little Alex' problem. In this paper, I reconstruct the argument Hauskeller derives from this thought experiment and subject it to critical scrutiny. I claim that the argument ultimately fails because (a) (...) it assumes that moral freedom is an intrinsic good when, in fact, it is more likely to be an axiological catalyst; and (b) there are reasons to think that moral enhancement does not undermine moral freedom. (shrink)

The enhancement of human traits has received academic attention for decades, but only recently has moral enhancement using biomedical means – moral bioenhancement (MB) – entered the discussion. After explaining why we ought to take the possibility of MB seriously, the paper considers the shape and content of moral improvement, addressing at some length a challenge presented by reasonable moral pluralism. The discussion then proceeds to this question: Assuming MB were safe, effective, and universally (...) available, would it be morally desirable? In particular, would it pose an unacceptable threat to human freedom? After defending a negative answer to the latter question – which requires an investigation into the nature and value of human freedom – and arguing that there is nothing inherently wrong with MB, the paper closes with reflections on what we should value in moral behaviour. (shrink)

Some say moral bioenhancements are urgent and necessary; others say they are misguided or simply will not work. I examine a class of arguments claiming that moral bioenhancements are problematic because they are self-subverting. On this view, trying to make oneself or others more moral, at least through certain means, can itself be immoral, or at least worse than the alternatives. The thought here is that moral enhancements might fail not for biological reasons, but for specifically (...) morally self-referential reasons. I argue that moral bioenhancements, in a restricted set of cases, are self-subverting such that they are impermissible. Further, some moral bioenhancements would result in agents who are less admirable than they might have been through other means. (shrink)

Opponents to genetic or biomedical human enhancement often claim that the availability of these technologies would have negative consequences for those who either choose not to utilize these resources or lack access to them. However, Thomas Douglas has argued that this objection has no force against the use of technologies that aim to bring about morally desirable character traits, as the unenhanced would benefit from being surrounded by such people. I will argue that things are not as straightforward as (...) Douglas makes out. The widespread use of moral enhancement would raise the standards for praise and blame worthiness, making it much harder for the unenhanced to perform praiseworthy actions or avoid performing blameworthy actions. This shows that supporters of moral enhancement cannot avoid this challenge in the way that Douglas suggests. (shrink)

Moral enhancement is an ostensibly laudable project. Who wouldn’t want people to become more moral? Still, the project’s approach is crucial. We can distinguish between two approaches for moral enhancement: direct and indirect. Direct moral enhancements aim at bringing about particular ideas, motives or behaviors. Indirect moral enhancements, by contrast, aim at making people more reliably produce the morally correct ideas, motives or behaviors without committing to the content of those ideas, motives and/or (...) actions. I will argue, on Millian grounds, that the value of disagreement puts serious pressure on proposals for relatively widespread direct moral enhancement. A more acceptable path would be to focus instead on indirect moral enhancements while staying neutral, for the most part, on a wide range of substantive moral claims. I will outline what such indirect moral enhancement might look like, and why we should expect it to lead to general moral improvement. (shrink)

One approach to defining enhancement is in the form of bodily or mental changes that tend to improve a person’s well-being. Such a “welfarist account”, however, seems to conflict with moral enhancement: consider an intervention that improves someone’s moral motives but which ultimately diminishes their well-being. According to the welfarist account, this would not be an instance of enhancement—in fact, as I argue, it would count as a disability. This seems to pose a serious limitation (...) for the account. Here, I elaborate on this limitation and argue that, despite it, there is a crucial role for such a welfarist account to play in our practical deliberations about moral enhancement. I do this by exploring four scenarios where a person’s motives are improved at the cost of their well-being. A framework emerges from these scenarios which can clarify disagreements about moral enhancement and help sharpen arguments for and against it. (shrink)

The moral enhancement (or bioenhancement) debate seems stuck in a dilemma. On the one hand, the more radical proposals, while certainly novel and interesting, seem unlikely to be feasible in practice, or if technically feasible then most likely imprudent. But on the other hand, the more sensible proposals – sensible in the sense of being both practically achievable and more plausibly ethically justifiable – can be rather hard to distinguish from both traditional forms of moral enhancement, (...) such as non-drug-mediated social or moral education, and non-moral forms of bioenhancement, such as smart-drug style cognitive enhancement. In this essay, I argue that bioethicists have paid insufficient attention to an alternative form of moral bioenhancement – or at least a likely candidate – that falls somewhere between these two extremes, namely the (appropriately qualified) use of certain psychedelic drugs. (shrink)

I discuss the argument of Persson and Savulescu that moral enhancement ought to accompany cognitive enhancement, as well as briefly addressing critiques of this argument, notably by John Harris. I argue that Harris, who believes that cognitive enhancement is largely sufficient for making us behave more morally, might be disposing too easily of the great quandary of our moral existence: the gap between what we do and what we believe is morally right to do. In (...) that regard, Persson and Savulescu's position has the potential to offer more. However, I question Persson and Savulescu's proposal of compulsory moral enhancement , proposing the alternative of voluntary moral enhancement. (shrink)

John Harris recently argues that the moral bioenhancement proposed by Persson and Savulescu can damage moral agency by depriving the recipients of their freedom to fall (freedom to make wrongful choices) and therefore should not be pursued. The link Harris makes between moral agency and the freedom to fall, however, implies that all forms of moral enhancement, including moral education, that aim to make the enhancement recipients less likely to “fall” are detrimental to (...) moral agency. In this paper, I present a new moral agency-based critique against the moral bioenhancement program envisaged by Persson and Savulescu. I argue that the irresistible influences exerted by the bioenhancement program harms our capabilities for conducting accurate self-reflection and forming decisions that truly express our will, which subsequently undermine our moral agency. (shrink)

Selective serotonin reuptake inhibitors (SSRIs) have gained a degree of prominence across recent moral enhancement literature as a possible intervention for dealing with antisocial and aggressive impulses. This is due to serotonin's purported capacity to modulate persons’ averseness to harm. The aim of this article is to argue that the use of SSRIs is not something worth getting particularly excited about as a practicable intervention for moral enhancement purposes, and that the generally uncritical enthusiasm over serotonin's (...) potential as a moral enhancer is a consequence of the paucity of viable options for envisaging practicable moral enhancement interventions. While there are many conceptual issues raised by the idea of moral enhancement generally, and by the idea of serotonin as a morally affective agent, the aim here is to look at practical concerns. It is argued that SSRIs do not, nor cannot in the reasonably foreseeable future, be made to work as a reliably safe or reliably effective means for moral enhancement, even within the very limited remit of treating “reactive” aggression. SSRIs might be effective as a limited and partial mental health intervention (even this is questionable), but not as a generally effective moral enhancement technology. (shrink)

Our present moral traits are unable to provide the level of large-scale co-operation necessary to deal with risks such as nuclear proliferation, drastic climate change and pandemics. In order to survive in an environment with powerful and easily available technologies, some authors claim that we need to improve our moral traits with moral enhancement. But this is prone to produce paradoxical effects, be self-reinforcing and harm personal identity. The risks of moral enhancement require the (...) use of a safety framework; such a framework should guarantee practical robustness to moral uncertainty, empirical adequacy, correct balance between dispositions, preservation of identity, and be sensitive to practical considerations such as emergent social effects. A virtue theory can meet all these desiderata. Possible frameworks incorporate them to variable degrees. The social value orientations framework is one of the most promising candidates. (shrink)